00000001:02000400:0.0F:1787377930.332426:0:2966:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787377951.728408:0:3187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787377953.784132:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 903 MB/s 00000001:01000000:2.0:1787377954.033900:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 711 MB/s 00000001:01000000:2.0:1787377954.283793:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3707 MB/s 00000020:02000000:0.0:1787377955.104325:0:3279:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_117_g8b0669c 00000400:02000000:0.0:1787377955.816290:0:3295:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.122@tcp [8/256/0/180] 00008000:02000000:0.0:1787377959.689681:0:3444:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1787378012.796338:0:5247:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787378021.188475:0:5772:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787378021.188483:0:5772:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787378021.188615:0:5772:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000c7344f45 00000080:02000400:3.0:1787378021.188627:0:5772:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787378021.200029:0:5772:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787378021.200049:0:5772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787378021.200224:0:5772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ce32d215) 00000020:00000080:3.0:1787378021.200255:0:5772:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787378021.233547:0:5772:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787378021.237287:0:5772:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787378021.291230:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787378021.291281:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787378021.291375:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787378021.291633:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787378021.293136:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787378021.293795:0:5772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787378021.293806:0:5772:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787378021.293821:0:5772:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7852916 00000020:01000004:2.0:1787378021.293831:0:5772:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787378021.293836:0:5772:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787378021.293840:0:5772:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c7344f45 from MGS 00000020:01000004:2.0:1787378021.293846:0:5772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787378021.293881:0:5772:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a6193805) 00000020:00000080:2.0:1787378021.293895:0:5772:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787378021.293985:0:5772:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c7344f45 from MGS, refs=2 00080000:01000000:2.0:1787378021.293992:0:5772:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787378021.294010:0:5772:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7852924 00000100:00100000:2.0:1787378021.294129:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787378021.294269:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787378021.294277:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0F:1787378021.301931:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787378021.301965:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787378021.308019:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378021.308271:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787378021.308280:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787378021.311080:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787378021.311098:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787378021.311540:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787378021.311548:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787378021.312662:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378021.312667:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378021.312675:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378021.315960:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378021.315972:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378021.315976:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378021.316921:0:5772:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787378021.330913:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787378021.566963:0:5772:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2871 MB/s 00000001:01000000:1.0:1787378021.817867:0:5772:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3043 MB/s 00000001:01000000:3.0:1787378022.068319:0:5772:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 515 MB/s 00000001:01000000:2.0:1787378022.317796:0:5772:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 495 MB/s 00080000:10000000:0.0:1787378022.336915:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787378022.361660:0:5772:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787378022.361690:0:5772:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787378022.361693:0:5772:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1787378022.369874:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787378022.370792:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787378022.371659:0:5772:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787378022.371773:0:5772:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787378022.372144:0:5772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787378022.372181:0:5772:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787378022.372643:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787378022.372870:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787378022.372878:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787378022.373795:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787378022.373803:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787378022.373947:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787378022.373952:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787378022.374229:0:5772:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787378022.374254:0:5772:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.122@tcp' 00000020:01000004:1.0:1787378022.374256:0:5772:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787378022.374300:0:5772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.122@tcp (typ=mgc) 00000020:00000080:1.0:1787378022.374319:0:5772:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.122@tcp (000000008050a432) 00000020:00000080:1.0:1787378022.374337:0:5772:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787378022.374492:0:5772:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000979d1ab@MGC192.168.203.122@tcp: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1787378022.374651:0:5772:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.122@tcp-0 is initialized 00000040:01000000:1.0:1787378022.374658:0:5772:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787378022.377072:0:5787:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787378022.377214:0:5788:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787378022.377259:0:5772:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.122@tcp (uuid fcf23d9b-e184-4291-9fe7-ec0ed8a185e6) 00000020:00000080:2.0:1787378022.377288:0:5772:0:(genops.c:1406:class_connect()) connect: client fcf23d9b-e184-4291-9fe7-ec0ed8a185e6, cookie 0xdd3c5462d7852932 00000100:00080000:2.0:1787378022.377303:0:5772:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787378022.377309:0:5772:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import 000000000979d1ab using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787378022.377371:0:5772:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b3837576 x1874201626542208/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787378022.388425:0:5772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS 00000020:01000004:2.0:1787378022.388473:0:5772:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787378022.388482:0:5772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787378022.388499:0:5772:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000063dde612) 00000020:00000080:2.0:1787378022.388535:0:5772:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787378022.391284:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3837576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3310:1874201626542208:0@lo:250: 00000100:00100000:1.0:1787378022.395761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378022.399898:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626542208 00000100:00100000:0.0:1787378022.399920:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626542208 00000100:00100000:0.0:1787378022.399988:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787378022.399996:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c3c8158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874201626542208:12345-0@lo:250: 00010000:00080000:0.0:1787378022.400031:0:5783:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fcf23d9b-e184-4291-9fe7-ec0ed8a185e6@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:0.0:1787378022.400073:0:5783:0:(genops.c:1406:class_connect()) connect: client fcf23d9b-e184-4291-9fe7-ec0ed8a185e6, cookie 0xdd3c5462d7852940 00000100:00080000:0.0:1787378022.400243:0:5783:0:(import.c:65:import_set_state_nolock()) 000000000184acf4 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378022.400356:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c3c8158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:3310:x1874201626542208:12345-0@lo:250: Request processed in 359us (4606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378022.400365:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787378022.400466:0:3310:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787378022.400476:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.122@tcp: connect to target with instance 0 00000100:00080000:0.0:1787378022.400486:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787378022.400491:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787378022.400495:0:3310:0:(import.c:65:import_set_state_nolock()) 000000000979d1ab MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787378022.400498:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787378022.400513:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787378022.400519:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3837576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3310:1874201626542208:0@lo:250: 00000100:00100000:2.0:1787378022.422376:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378022.423046:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787378022.423053:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787378022.424428:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787378022.424517:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787378022.425333:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787378022.425344:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787378022.427129:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378022.427378:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787378022.427385:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787378022.428350:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787378022.428359:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787378022.494619:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378022.495025:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787378022.495034:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787378022.497295:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787378022.497318:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787378022.498362:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787378022.498627:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787378022.498634:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787378022.499574:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787378022.499584:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787378022.500623:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378022.501005:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787378022.501012:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787378022.501599:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787378022.501607:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787378022.502230:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378022.502391:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787378022.502397:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787378022.503308:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787378022.503317:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787378022.541632:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378022.542016:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787378022.542024:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787378022.544061:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787378022.544079:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787378022.547547:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787378022.547568:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787378022.549151:0:5772:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787378022.549178:0:5772:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787378022.549184:0:5772:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787378022.549366:0:5772:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787378022.549410:0:5772:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787378022.549418:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787378022.549420:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787378022.549421:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378022.549422:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378022.549423:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378022.549425:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378022.549426:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787378022.549428:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787378022.549429:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787378022.549430:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787378022.549431:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378022.549432:0:5772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787378022.549435:0:5772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787378022.549437:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787378022.549438:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787378022.549439:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378022.549440:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378022.549441:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378022.549442:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378022.549443:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787378022.549443:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787378022.549444:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787378022.549445:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787378022.549446:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378022.549447:0:5772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787378022.549505:0:5772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787378022.549535:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542336:0@lo:253: 00000100:00100000:3.0:1787378022.549628:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378022.549762:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000061dac032 going to sleep for 11 seconds 00000100:00100000:1.0:1787378022.549930:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626542336 00000100:00100000:1.0:1787378022.550101:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626542336 00000100:00100000:1.0:1787378022.550185:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787378022.550194:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006047d388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:5772:x1874201626542336:12345-0@lo:253: 20000000:01000000:1.0:1787378022.550250:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787378022.550253:0:5786:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787378022.553242:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787378022.553345:0:5786:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787378022.553706:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787378022.555356:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787378022.557499:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787378022.557741:0:5786:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787378022.557750:0:5786:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787378022.557753:0:5786:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787378022.557785:0:5786:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787378022.558101:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787378022.558332:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787378022.558349:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787378022.558425:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787378022.558493:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787378022.560044:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787378022.560212:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787378022.560223:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787378022.560292:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787378022.560302:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787378022.560336:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787378022.560344:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787378022.560376:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787378022.561817:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787378022.561892:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787378022.561919:0:5786:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787378022.561940:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787378022.562161:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787378022.562173:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787378022.562212:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787378022.562251:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787378022.562302:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787378022.562315:0:5786:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787378022.562393:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787378022.562403:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787378022.562475:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787378022.564395:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787378022.564496:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787378022.564516:0:5786:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787378022.564700:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787378022.564713:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787378022.567438:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787378022.567522:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787378022.567989:0:5786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787378022.568042:0:5786:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787378022.568051:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787378022.572047:0:5808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787378022.572530:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787378022.572565:0:5786:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.122@tcp for mdt 20000000:01000000:1.0:1787378022.572568:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787378022.572608:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787378022.572616:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787378022.572650:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787378022.572658:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1787378022.572950:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787378022.572962:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787378022.572998:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787378022.573061:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787378022.573136:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787378022.573140:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787378022.573145:0:5786:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787378022.573153:0:5786:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787378022.574244:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1787378022.574602:0:5786:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787378022.592228:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787378022.592314:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787378022.592421:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787378022.592443:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787378022.592446:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787378022.592461:0:5786:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787378022.592478:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787378022.592481:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787378022.592516:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787378022.592519:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787378022.594105:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787378022.594780:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787378022.594840:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787378022.594879:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787378022.594893:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787378022.594896:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787378022.595559:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1787378022.596599:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1787378022.596660:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1787378022.596955:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1787378022.596973:0:5786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787378022.596976:0:5786:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1787378022.596984:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787378022.597009:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597028:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597041:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597048:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597055:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597061:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597068:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2c6d7c6 already unused, calling callback (00000000e02d88ef) 00010000:00010000:0.0:1787378022.597078:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597087:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597101:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597109:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378022.597115:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2c6d7c6/0xdd3c5462d7852947 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787378022.597133:0:5786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787378022.863422:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006047d388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:5772:x1874201626542336:12345-0@lo:253: Request processed in 313221us (313785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378022.863443:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787378022.863577:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542336:0@lo:253: 10000000:01000000:3.0:1787378022.863597:0:5772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787378022.863601:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787378022.863603:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787378022.863622:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378022.863624:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787378022.863626:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378022.863628:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378022.863629:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787378022.863631:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787378022.863633:0:5772:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787378022.863634:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378022.863636:0:5772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787378022.863667:0:5772:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c7344f45 from lustre-MDT0000 10000000:01000000:3.0:1787378022.863767:0:5772:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787378022.863772:0:5772:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787378022.863777:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9eeb882799c0 10000000:01000000:3.0:1787378022.863787:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787378022.863798:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9eeb882799c0 from 1 10000000:01000000:3.0:1787378022.863801:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787378022.863855:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000008fedeb14/0xdd3c5462d785294e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.863871:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000008fedeb14/0xdd3c5462d785294e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.863882:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000008fedeb14/0xdd3c5462d785294e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378022.863906:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542464:0@lo:101: 00000100:00100000:3.0:1787378022.863950:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378022.864032:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030765061 going to sleep for 11 seconds 00000100:00100000:1.0:1787378022.864148:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626542464 00000100:00100000:1.0:1787378022.864155:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626542464 00000100:00100000:1.0:1787378022.864192:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787378022.864200:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b67cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:5772:x1874201626542464:12345-0@lo:101: 00010000:00010000:1.0:1787378022.864214:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378022.864229:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a2bffad/0xdd3c5462d7852955 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d785294e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378022.864253:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a2bffad/0xdd3c5462d7852955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d785294e expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378022.864263:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a2bffad/0xdd3c5462d7852955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d785294e expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378022.864284:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a2bffad, rc 0) 00000100:00100000:1.0:1787378022.864326:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b67cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+6:5772:x1874201626542464:12345-0@lo:101: Request processed in 127us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378022.864333:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787378022.864406:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542464:0@lo:101: 00010000:00010000:3.0:1787378022.864422:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000008fedeb14/0xdd3c5462d785294e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.864429:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000008fedeb14/0xdd3c5462d785294e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378022.864495:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542592:0@lo:501: 00000100:00100000:3.0:1787378022.864520:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378022.864539:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030765061 going to sleep for 11 seconds 00000100:00100000:1.0:1787378022.864589:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626542592 00000100:00100000:1.0:1787378022.864593:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626542592 00000100:00100000:1.0:1787378022.864622:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787378022.864628:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ee08798 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+6:5772:x1874201626542592:12345-0@lo:501: 00000100:00100000:1.0:1787378022.864903:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ee08798 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+6:5772:x1874201626542592:12345-0@lo:501: Request processed in 275us (381us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787378022.864911:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787378022.865036:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542592:0@lo:501: 10000000:01000000:3.0:1787378022.865066:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787378022.865086:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000008fedeb14/0xdd3c5462d785294e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.865094:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000008fedeb14/0xdd3c5462d785294e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378022.865103:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eeb8a31b800 10000000:01000000:3.0:1787378022.865107:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787378022.865111:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9eeb8a31b800 10000000:01000000:3.0:1787378022.865113:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787378022.865116:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9eeb8a31b800 from 1 10000000:01000000:3.0:1787378022.865118:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787378022.865135:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000002e79c566/0xdd3c5462d785295c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.865142:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000002e79c566/0xdd3c5462d785295c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.865150:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000002e79c566/0xdd3c5462d785295c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378022.865161:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542720:0@lo:101: 00000100:00100000:3.0:1787378022.865212:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378022.865271:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626542720 00000100:00100000:1.0:1787378022.865276:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626542720 00000100:00100000:1.0:1787378022.865300:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787378022.865305:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef102bb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+6:5772:x1874201626542720:12345-0@lo:101: 00010000:00010000:1.0:1787378022.865313:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378022.865323:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4f09cfa/0xdd3c5462d7852963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d785295c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378022.865339:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4f09cfa/0xdd3c5462d7852963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d785295c expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378022.865346:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4f09cfa/0xdd3c5462d7852963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d785295c expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378022.865353:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4f09cfa, rc 0) 00000100:00100000:1.0:1787378022.865376:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef102bb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+7:5772:x1874201626542720:12345-0@lo:101: Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378022.865394:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787378022.865606:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030765061 going to sleep for 11 seconds 00000100:00100000:3.0:1787378022.865620:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542720:0@lo:101: 00010000:00010000:3.0:1787378022.865631:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000002e79c566/0xdd3c5462d785295c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.865643:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000002e79c566/0xdd3c5462d785295c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378022.865660:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787378022.865981:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000002e79c566/0xdd3c5462d785295c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.865990:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000002e79c566/0xdd3c5462d785295c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378022.865997:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787378022.866001:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787378022.866006:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9eeb8a31b800 10000000:01000000:3.0:1787378022.866008:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787378022.866011:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787378022.866014:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787378022.866031:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000e4eaa0d7/0xdd3c5462d785296a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.866040:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000e4eaa0d7/0xdd3c5462d785296a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.866048:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000e4eaa0d7/0xdd3c5462d785296a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378022.866070:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542848:0@lo:101: 00000100:00100000:3.0:1787378022.866102:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378022.866191:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030765061 going to sleep for 11 seconds 00000100:00100000:2.0:1787378022.866264:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626542848 00000100:00100000:2.0:1787378022.866270:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626542848 00000100:00100000:2.0:1787378022.866343:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787378022.866350:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016d71d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+7:5772:x1874201626542848:12345-0@lo:101: 00010000:00010000:2.0:1787378022.866359:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378022.866369:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd66c35f/0xdd3c5462d7852971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d785296a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378022.866386:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd66c35f/0xdd3c5462d7852971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d785296a expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378022.866393:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd66c35f/0xdd3c5462d7852971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d785296a expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378022.866400:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd66c35f, rc 0) 00000100:00100000:2.0:1787378022.866471:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016d71d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+8:5772:x1874201626542848:12345-0@lo:101: Request processed in 122us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378022.866478:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787378022.866538:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542848:0@lo:101: 00010000:00010000:3.0:1787378022.866549:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000e4eaa0d7/0xdd3c5462d785296a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378022.866555:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000e4eaa0d7/0xdd3c5462d785296a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378022.866601:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542976:0@lo:501: 00000100:00100000:3.0:1787378022.866627:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378022.866973:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030765061 going to sleep for 11 seconds 00000100:00100000:0.0:1787378022.867063:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626542976 00000100:00100000:0.0:1787378022.867069:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626542976 00000100:00100000:1.0:1787378022.867246:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378022.867253:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003110861d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+8:5772:x1874201626542976:12345-0@lo:501: 00000100:00100000:1.0:1787378022.867519:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003110861d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:5772:x1874201626542976:12345-0@lo:501: Request processed in 267us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378022.867527:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787378022.867592:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626542976:0@lo:501: 00000100:00100000:3.0:1787378022.867627:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543104:0@lo:503: 00000100:00100000:3.0:1787378022.867664:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378022.868019:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030765061 going to sleep for 11 seconds 00000100:00100000:2.0:1787378022.868055:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626543104 00000100:00100000:2.0:1787378022.868060:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626543104 00000100:00100000:0.0:1787378022.868100:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787378022.868108:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db5fa33d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:5772:x1874201626543104:12345-0@lo:503: 00000100:00100000:0.0:1787378022.868271:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db5fa33d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:5772:x1874201626543104:12345-0@lo:503: Request processed in 165us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378022.868278:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787378022.868386:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543104:0@lo:503: 00000100:00100000:1.0:1787378022.869000:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bedd186e pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5813:1874201626543232:0@lo:502: 00000100:00100000:1.0:1787378022.869049:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378022.869079:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac31465c going to sleep for 11 seconds 00000100:00100000:0.0:1787378022.869132:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626543232 00000100:00100000:0.0:1787378022.869136:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626543232 00000100:00100000:0.0:1787378022.869167:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787378022.869172:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078ab722f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:5813:x1874201626543232:12345-0@lo:502: 00000100:00100000:0.0:1787378022.869345:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078ab722f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:5813:x1874201626543232:12345-0@lo:502: Request processed in 173us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378022.869353:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787378022.869481:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bedd186e pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5813:1874201626543232:0@lo:502: 00000020:01000000:3.0:1787378022.869510:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787378022.869522:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378022.869524:0:5813:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787378022.869531:0:5813:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787378022.869535:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787378022.869553:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003decd303) 00000020:00000080:3.0:1787378022.869570:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787378022.869577:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787378022.869653:0:5813:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787378022.869673:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d785297f 00000020:00000080:3.0:1787378022.870001:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787378022.870005:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378022.870009:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378022.870011:0:5813:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787378022.870013:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787378022.870017:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378022.870018:0:5813:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787378022.870021:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787378022.870028:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bb725894) 00000020:00000080:3.0:1787378022.870038:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787378022.870042:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787378022.870044:0:5813:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787378022.870047:0:5813:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787378022.870053:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787378022.870087:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c7344f45 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787378022.870098:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c5800901) 00000020:00000080:3.0:1787378022.870104:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787378022.870169:0:5813:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787378022.870176:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7852994 00000020:00000080:3.0:1787378022.870264:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787378022.870271:0:5813:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787378022.870275:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdd3c5462d785299b 00080000:01000000:3.0:1787378022.870279:0:5813:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787378022.870282:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d78529a2 00080000:10000000:3.0:1787378022.870691:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787378022.871249:0:5813:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787378022.876565:0:5813:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787378022.970526:0:5813:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787378022.971214:0:5813:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787378022.975113:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787378022.975671:0:5813:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787378023.009235:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005d9343ea) 00000020:00000080:1.0:1787378023.009259:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787378023.009321:0:5813:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787378023.009328:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d78529b0 00000020:00000080:0.0:1787378023.015223:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787378023.017017:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787378023.082272:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787378023.154044:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787378023.205678:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787378023.260233:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378023.301952:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787378023.367074:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdd3c5462d78529b7 00000020:00000080:1.0:1787378023.367526:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787378023.367538:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378023.367546:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378023.367548:0:5813:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787378023.367551:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378023.367556:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378023.367558:0:5813:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787378023.367562:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787378023.367598:0:5813:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787378023.367611:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378023.367614:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378023.367616:0:5813:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787378023.367618:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378023.367620:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378023.367622:0:5813:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787378023.367632:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787378023.367634:0:5813:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787378023.367680:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cf9218bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5813:1874201626543360:0@lo:502: 00000100:00100000:2.0:1787378023.370471:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378023.370623:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 00000000314bc531 going to sleep for 11 seconds 00000100:00100000:1.0:1787378023.370776:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626543360 00000100:00100000:1.0:1787378023.370786:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626543360 00000100:00100000:1.0:1787378023.370880:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787378023.370889:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062b64d2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:5813:x1874201626543360:12345-0@lo:502: 00000100:00100000:1.0:1787378023.371418:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062b64d2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:5813:x1874201626543360:12345-0@lo:502: Request processed in 528us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378023.371427:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787378023.371538:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cf9218bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5813:1874201626543360:0@lo:502: 00000020:01000000:0.0:1787378023.371571:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378023.371579:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378023.371581:0:5813:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787378023.371588:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787378023.371881:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787378023.371913:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787378023.371935:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000e4eaa0d7/0xdd3c5462d785296a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.371947:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000e4eaa0d7/0xdd3c5462d785296a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378023.371956:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9eeb8a31b800 from 1 10000000:01000000:3.0:1787378023.371959:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787378023.371997:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.372005:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.372013:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378023.372030:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543488:0@lo:101: 00000100:00100000:3.0:1787378023.372076:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378023.372307:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2f512d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787378023.372431:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626543488 00000100:00100000:2.0:1787378023.372437:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626543488 00000100:00100000:2.0:1787378023.372471:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787378023.372476:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c9e0bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:5772:x1874201626543488:12345-0@lo:101: 00010000:00010000:2.0:1787378023.372488:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378023.372501:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d78529be expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378023.372523:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d78529be expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378023.372532:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d78529be expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378023.372542:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081d3d3b6, rc 0) 00000100:00100000:2.0:1787378023.372578:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c9e0bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:5772:x1874201626543488:12345-0@lo:101: Request processed in 101us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378023.372584:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787378023.372679:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543488:0@lo:101: 00010000:00010000:3.0:1787378023.372690:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.372698:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378023.373296:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543616:0@lo:256: 00000100:00100000:3.0:1787378023.373345:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378023.373434:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2f512d2 going to sleep for 11 seconds 00000100:00100000:0.0:1787378023.373498:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626543616 00000100:00100000:0.0:1787378023.373503:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626543616 00000100:00100000:2.0:1787378023.373545:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378023.373551:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002c18400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:5772:x1874201626543616:12345-0@lo:256: 20000000:01000000:2.0:1787378023.373565:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787378023.373571:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787378023.373634:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002c18400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:5772:x1874201626543616:12345-0@lo:256: Request processed in 84us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378023.373641:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787378023.373706:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543616:0@lo:256: 10000000:01000000:3.0:1787378023.374359:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787378023.374429:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.374439:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378023.374456:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb8a31b800 from 1 10000000:01000000:3.0:1787378023.374458:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787378023.374485:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.374492:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.374500:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378023.374512:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543744:0@lo:101: 00000100:00100000:3.0:1787378023.374545:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378023.374578:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2f512d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787378023.374661:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626543744 00000100:00100000:2.0:1787378023.374666:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626543744 00000100:00100000:2.0:1787378023.374705:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787378023.374744:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000628fe852 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:5772:x1874201626543744:12345-0@lo:101: 00010000:00010000:2.0:1787378023.374754:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378023.374766:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d78529cc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378023.374787:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378023.374798:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378023.374806:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000024ad8ac0, rc 0) 00000100:00100000:2.0:1787378023.374837:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000628fe852 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5772:x1874201626543744:12345-0@lo:101: Request processed in 117us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378023.374844:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787378023.374925:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543744:0@lo:101: 00010000:00010000:3.0:1787378023.374938:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.374948:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378023.375032:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543872:0@lo:501: 00000100:00100000:3.0:1787378023.375096:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378023.375135:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2f512d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787378023.375300:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626543872 00000100:00100000:2.0:1787378023.375304:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626543872 00000100:00100000:2.0:1787378023.375351:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787378023.375360:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089bd0d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5772:x1874201626543872:12345-0@lo:501: 00000100:00100000:2.0:1787378023.376021:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089bd0d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5772:x1874201626543872:12345-0@lo:501: Request processed in 661us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378023.376030:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787378023.376396:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626543872:0@lo:501: 00000100:00100000:3.0:1787378023.376441:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544000:0@lo:503: 00000100:00100000:3.0:1787378023.376496:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378023.376532:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2f512d2 going to sleep for 11 seconds 00000100:00100000:0.0:1787378023.376588:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626544000 00000100:00100000:0.0:1787378023.376595:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626544000 00000100:00100000:0.0:1787378023.376649:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787378023.376656:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dce3cedd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5772:x1874201626544000:12345-0@lo:503: 00000040:00080000:0.0:1787378023.376697:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787378023.376765:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dce3cedd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5772:x1874201626544000:12345-0@lo:503: Request processed in 110us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378023.376772:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787378023.376845:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544000:0@lo:503: 00000040:00080000:3.0:1787378023.378024:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787378023.378494:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787378023.378520:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787378023.378541:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.378554:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378023.378615:0:5772:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787378023.378620:0:5772:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eeb8a31b800 10000000:01000000:1.0:1787378023.378624:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eeb8a31b800 10000000:01000000:1.0:1787378023.378630:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787378023.378639:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eeb8a31b800 from 1 10000000:01000000:1.0:1787378023.378643:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787378023.378680:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000008416e6c0/0xdd3c5462d78529da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.378689:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000008416e6c0/0xdd3c5462d78529da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.378737:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000008416e6c0/0xdd3c5462d78529da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378023.378758:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1155ee7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544128:0@lo:101: 00000100:00100000:1.0:1787378023.378817:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378023.378848:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000004868cb23 going to sleep for 11 seconds 00000100:00100000:3.0:1787378023.378929:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626544128 00000100:00100000:3.0:1787378023.378939:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626544128 00000100:00100000:3.0:1787378023.379011:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787378023.379024:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5eb9492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5772:x1874201626544128:12345-0@lo:101: 00010000:00010000:3.0:1787378023.379057:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378023.379079:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000093a66880/0xdd3c5462d78529e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d78529da expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.379112:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000093a66880/0xdd3c5462d78529e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d78529da expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.379127:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000093a66880/0xdd3c5462d78529e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d78529da expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.379139:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000093a66880, rc 0) 00000100:00100000:3.0:1787378023.379194:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5eb9492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5772:x1874201626544128:12345-0@lo:101: Request processed in 173us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378023.379218:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787378023.379438:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1155ee7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544128:0@lo:101: 00010000:00010000:1.0:1787378023.379462:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000008416e6c0/0xdd3c5462d78529da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.379470:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000008416e6c0/0xdd3c5462d78529da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378023.379527:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1155ee7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544256:0@lo:501: 00000100:00100000:1.0:1787378023.379557:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378023.379589:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000004868cb23 going to sleep for 11 seconds 00000100:00100000:3.0:1787378023.379832:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626544256 00000100:00100000:3.0:1787378023.379839:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626544256 00000100:00100000:3.0:1787378023.379888:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787378023.379897:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a1a8a9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5772:x1874201626544256:12345-0@lo:501: 00000100:00100000:3.0:1787378023.380250:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a1a8a9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5772:x1874201626544256:12345-0@lo:501: Request processed in 353us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378023.380260:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378023.380440:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1155ee7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544256:0@lo:501: 00000100:00100000:1.0:1787378023.380482:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1155ee7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544384:0@lo:503: 00000100:00100000:1.0:1787378023.380530:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378023.380560:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000004868cb23 going to sleep for 11 seconds 00000100:00100000:3.0:1787378023.380630:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626544384 00000100:00100000:3.0:1787378023.380637:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626544384 00000100:00100000:3.0:1787378023.380945:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787378023.380957:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e85b7ccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5772:x1874201626544384:12345-0@lo:503: 00000100:00100000:3.0:1787378023.381433:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e85b7ccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5772:x1874201626544384:12345-0@lo:503: Request processed in 480us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378023.381441:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787378023.381530:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1155ee7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544384:0@lo:503: 00000100:00100000:0.0:1787378023.382005:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c6855ada pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5818:1874201626544512:0@lo:502: 00000100:00100000:0.0:1787378023.382110:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378023.382452:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 000000004868cb23 going to sleep for 11 seconds 00000100:00100000:1.0:1787378023.382484:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626544512 00000100:00100000:1.0:1787378023.382491:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626544512 00000100:00100000:1.0:1787378023.382524:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787378023.382530:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f59f1a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5818:x1874201626544512:12345-0@lo:502: 00000100:00100000:1.0:1787378023.382961:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f59f1a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5818:x1874201626544512:12345-0@lo:502: Request processed in 428us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378023.382981:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787378023.383467:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c6855ada pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5818:1874201626544512:0@lo:502: 00000020:01000004:0.0:1787378023.383534:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787378023.383558:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d0434097) 00000020:00000080:0.0:1787378023.383578:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787378023.384453:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c7344f45 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787378023.384459:0:5818:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c7344f45 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787378023.384462:0:5818:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c7344f45 4 00010000:00080000:2.0:1787378023.384499:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005ae3f1fe@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1787378023.386022:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378023.392701:0:5818:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787378023.393678:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787378023.394028:0:5818:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787378023.394540:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdd3c5462d78529ef 00000100:00080000:2.0:1787378023.394552:0:5818:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787378023.394558:0:5818:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005ae3f1fe using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787378023.394600:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008f85b1eb x1874201626544640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787378023.394688:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008f85b1eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626544640:0@lo:38: 00000100:00100000:0.0:1787378023.394802:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787378023.395664:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787378023.395888:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626544640 00000100:00100000:1.0:1787378023.395900:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626544640 00000100:00100000:1.0:1787378023.395965:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787378023.395974:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6855ada pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874201626544640:12345-0@lo:38: 00000100:00100000:3.0:1787378023.396331:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5818:1874201626544768:0@lo:502: 00000100:00100000:3.0:1787378023.396402:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378023.396455:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626544768 00000100:00100000:3.0:1787378023.396459:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626544768 00000100:00100000:3.0:1787378023.396497:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787378023.396503:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc0740a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5818:x1874201626544768:12345-0@lo:502: 00000100:00100000:3.0:1787378023.396745:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc0740a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5818:x1874201626544768:12345-0@lo:502: Request processed in 241us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378023.396753:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787378023.396874:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1e680e5 going to sleep for 11 seconds 00000100:00100000:3.0:1787378023.396904:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5818:1874201626544768:0@lo:502: 00000040:00080000:3.0:1787378023.396955:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787378023.400750:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787378023.400799:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787378023.400828:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000008416e6c0/0xdd3c5462d78529da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.400843:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000008416e6c0/0xdd3c5462d78529da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787378023.400917:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787378023.400920:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787378023.400922:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378023.400923:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378023.400925:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378023.400926:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378023.400928:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787378023.400929:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787378023.400931:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787378023.400933:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787378023.400935:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378023.400937:0:5772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787378023.400942:0:5772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787378023.400945:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787378023.400946:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787378023.400947:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378023.400949:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378023.400950:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378023.400951:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378023.400952:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787378023.400953:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787378023.400954:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787378023.400955:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787378023.400956:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378023.400957:0:5772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787378023.400992:0:5772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787378023.401013:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544896:0@lo:253: 00000100:00100000:3.0:1787378023.401133:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378023.401180:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1e680e5 going to sleep for 11 seconds 00000100:00100000:3.0:1787378023.401222:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626544896 00000100:00100000:3.0:1787378023.401231:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626544896 00000100:00100000:3.0:1787378023.401287:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787378023.401295:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cd83067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5772:x1874201626544896:12345-0@lo:253: 20000000:01000000:3.0:1787378023.401327:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787378023.401344:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787378023.404232:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6855ada pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874201626544640:12345-0@lo:38: Request processed in 8249us (9423us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787378023.404252:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787378023.410994:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787378023.411013:0:3310:0:(import.c:65:import_set_state_nolock()) 000000005ae3f1fe lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787378023.411021:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787378023.411025:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008f85b1eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626544640:0@lo:38: 20000000:01000000:1.0:1787378023.456873:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787378023.456903:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787378023.457916:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787378023.457923:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787378023.457950:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.457973:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d78529be expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.457982:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.458026:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d78529be expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378023.458042:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d78529be expref: 12 pid: 5786 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378023.458057:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e1db5cf2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874201626545024:0@lo:104: 00000100:00100000:3.0:1787378023.458121:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378023.458186:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9203550 going to sleep for 11 seconds 00000100:00100000:2.0:1787378023.458314:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626545024 00000100:00100000:2.0:1787378023.458322:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626545024 00000100:00100000:2.0:1787378023.458372:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378023.458380:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f81964ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5806:x1874201626545024:12345-0@lo:104: 00010000:00010000:2.0:1787378023.458393:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378023.458465:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787378023.458471:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f81964ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5806:x1874201626545024:12345-0@lo:104: Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378023.458478:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787378023.458493:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e1db5cf2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874201626545024:0@lo:104: 00010000:00010000:0.0:1787378023.458511:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.458547:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378023.458553:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.458561:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063ffc67b already unused, calling callback (00000000548bd61c) 10000000:00010000:1.0:1787378023.458564:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.458571:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378023.458577:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378023.458583:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378023.458617:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.458630:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378023.458850:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.458870:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 0000000063ffc67b/0xdd3c5462d78529be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529c5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.458888:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378023.458889:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378023.458890:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378023.458930:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000066c3be35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626545152:0@lo:103: 00000100:00100000:0.0:1787378023.458966:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378023.459096:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626545152 00000100:00100000:1.0:1787378023.459101:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626545152 00010000:00010000:1.0:1787378023.459120:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d78529be expref: 13 pid: 5786 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378023.459153:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787378023.459160:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce8e557d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3312:x1874201626545152:12345-0@lo:103: 00010000:00010000:1.0:1787378023.459171:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378023.459175:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d78529be expref: 13 pid: 5786 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459185:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d78529be expref: 13 pid: 5786 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459199:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081d3d3b6/0xdd3c5462d78529c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d78529be expref: 13 pid: 5786 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459213:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459220:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787378023.459244:0:5776:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001320880s 00010000:00010000:1.0:1787378023.459248:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459254:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459260:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459265:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459270:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000690fa1df already unused, calling callback (00000000e02d88ef) 00010000:00010000:1.0:1787378023.459274:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459280:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459294:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459303:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378023.459340:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce8e557d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3312:x1874201626545152:12345-0@lo:103: Request processed in 181us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378023.459347:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787378023.459374:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000066c3be35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626545152:0@lo:103: 00010000:00010000:1.0:1787378023.459393:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459406:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378023.459411:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000690fa1df/0xdd3c5462d78529f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378023.473086:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cd83067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5772:x1874201626544896:12345-0@lo:253: Request processed in 71783us (71947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378023.473103:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787378023.473201:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5772:1874201626544896:0@lo:253: 10000000:01000000:3.0:1787378023.473218:0:5772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787378023.473238:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787378023.473240:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787378023.473241:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378023.473243:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378023.473244:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378023.473245:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378023.473247:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787378023.473248:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787378023.473249:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787378023.473251:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787378023.473253:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378023.473254:0:5772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787378023.473280:0:5772:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787378023.482242:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787378023.484017:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787378023.484367:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787378023.485402:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787378023.486119:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787378023.486368:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787378023.488254:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787378023.488468:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787378023.488919:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787378023.489137:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787378023.489409:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787378023.490143:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787378023.545302:0:5772:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787378023.596291:0:5772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787378023.597071:0:5824:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787378023.599420:0:5823:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787378023.599426:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787378023.602985:0:5772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787378023.603284:0:5772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787378023.603948:0:5772:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787378023.603959:0:5772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787378023.604194:0:5772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787378023.615594:0:5772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787378023.616106:0:5772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787378023.616150:0:5772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787378023.616478:0:5772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787378023.616698:0:5772:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787378023.624652:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787378023.625217:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787378023.625430:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787378023.627385:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787378023.628023:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787378023.628602:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787378023.628815:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787378023.628998:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787378023.629532:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787378023.629696:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787378023.630004:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787378023.630517:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787378023.631191:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787378023.631385:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787378023.631872:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787378023.632314:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787378023.633274:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787378023.633488:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787378023.634077:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787378023.634309:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787378023.635231:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787378023.635469:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787378023.635821:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787378023.636158:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787378023.636424:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787378023.637266:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787378023.637764:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787378023.637908:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787378023.638225:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787378023.638427:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787378023.638885:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787378023.639363:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787378023.641189:0:5772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787378023.679344:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787378023.752710:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787378023.752852:0:5824:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787378023.752858:0:5824:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1787378023.753108:0:5772:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787378023.753133:0:5772:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb59a01d77988 00100000:10000000:0.0:1787378023.753142:0:5772:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787378023.755058:0:5772:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787378023.755076:0:5772:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787378023.755094:0:5772:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787378023.755112:0:5772:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787378024.410153:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378025.436564:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378026.457866:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378027.482184:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787378028.077324:0:6067:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787378028.505827:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787378028.570181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787378028.570196:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787378028.570199:0:37:0:(import.c:65:import_set_state_nolock()) 000000005ae3f1fe lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787378028.570212:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005ae3f1fe using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787378028.570234:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002c1de2a2 x1874201626545408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787378028.570270:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c1de2a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626545408:0@lo:38: 00000100:00100000:0.0:1787378028.570339:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378028.570529:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378028.570539:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad221c6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626545280:0@lo:400: 00000100:00100000:1.0:1787378028.570585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378028.570638:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626545408 00000100:00100000:1.0:1787378028.570645:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626545408 00000100:00100000:1.0:1787378028.570681:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787378028.570689:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011487be4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874201626545408:12345-0@lo:38: 00010000:00080000:1.0:1787378028.570715:0:5792:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1787378028.570774:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdd3c5462d78529fd 00000004:00100000:1.0:1787378028.570828:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787378028.570952:0:5792:0:(import.c:65:import_set_state_nolock()) 000000003f105706 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787378028.571017:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011487be4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874201626545408:12345-0@lo:38: Request processed in 328us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378028.571037:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787378028.571609:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626545280 00000100:00100000:0.0:1787378028.571616:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626545280 00000100:00100000:0.0:1787378028.571656:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787378028.571671:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000743dad2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:3314:x1874201626545280:12345-0@lo:400: 00000100:00100000:0.0:1787378028.571752:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000743dad2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:3314:x1874201626545280:12345-0@lo:400: Request processed in 81us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378028.571763:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787378028.572540:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad221c6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626545280:0@lo:400: 00010000:00080000:2.0:1787378028.573379:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002c1de2a2 x1874201626545408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787378038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787378028.573399:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787378028.573419:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787378028.573425:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787378028.573428:0:3310:0:(import.c:65:import_set_state_nolock()) 000000005ae3f1fe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787378028.573434:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c1de2a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626545408:0@lo:38: 00010000:00010000:2.0:1787378029.531394:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787378030.106161:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787378030.106186:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9eeb8a31b800 from 3 10000000:01000000:2.0:1787378030.106191:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787378030.106281:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000c6a1c224/0xdd3c5462d7852a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378030.106294:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000c6a1c224/0xdd3c5462d7852a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378030.106304:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000c6a1c224/0xdd3c5462d7852a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378030.106327:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008afcf9aa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626545536:0@lo:101: 00000100:00100000:2.0:1787378030.106418:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378030.106495:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000321359a4 going to sleep for 11 seconds 00000100:00100000:1.0:1787378030.106677:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626545536 00000100:00100000:1.0:1787378030.106686:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626545536 00000100:00100000:1.0:1787378030.106776:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787378030.106785:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc978bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5788:x1874201626545536:12345-0@lo:101: 00010000:00010000:1.0:1787378030.106798:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378030.106813:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b21bca5/0xdd3c5462d7852a0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852a04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378030.106836:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b21bca5/0xdd3c5462d7852a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378030.106845:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b21bca5/0xdd3c5462d7852a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378030.106854:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b21bca5, rc 0) 00000100:00100000:1.0:1787378030.106906:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc978bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626545536:12345-0@lo:101: Request processed in 123us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378030.106913:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787378030.107147:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008afcf9aa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626545536:0@lo:101: 00010000:00010000:2.0:1787378030.107161:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000c6a1c224/0xdd3c5462d7852a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378030.107169:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000c6a1c224/0xdd3c5462d7852a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378030.107221:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008afcf9aa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626545664:0@lo:256: 00000100:00100000:2.0:1787378030.107254:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378030.107279:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000321359a4 going to sleep for 11 seconds 00000100:00100000:3.0:1787378030.107754:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626545664 00000100:00100000:3.0:1787378030.107762:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626545664 00000100:00100000:3.0:1787378030.107813:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787378030.107819:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001085640c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626545664:12345-0@lo:256: 20000000:01000000:3.0:1787378030.107835:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787378030.107855:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787378030.107858:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787378030.107946:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001085640c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626545664:12345-0@lo:256: Request processed in 127us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378030.107954:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787378030.108114:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008afcf9aa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626545664:0@lo:256: 10000000:01000000:2.0:1787378030.108152:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787378030.108159:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000c6a1c224/0xdd3c5462d7852a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378030.108175:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000c6a1c224/0xdd3c5462d7852a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378030.554027:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378031.583689:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378032.602035:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787378032.821570:0:6268:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc4b8ad190 00000020:00000080:2.0:1787378032.821814:0:6268:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787378032.821819:0:6268:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787378032.821829:0:6268:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4b8af420 20000000:00000080:2.0:1787378032.821837:0:6268:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eeb8448f800 uarg=0000000000000000 20000000:01000000:2.0:1787378032.822032:0:6268:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787378032.822040:0:6268:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787378032.822045:0:6268:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787378032.824068:0:6268:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787378032.824084:0:6268:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787378032.828608:0:6268:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787378032.829175:0:6268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787378032.829235:0:6268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787378032.829284:0:6268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787378032.829304:0:6268:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787378032.829322:0:6268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378032.829342:0:6268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378032.831711:0:6268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378032.832491:0:6268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378032.832511:0:6268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 11 pid: 5783 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378032.832528:0:6268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6268:1874201626545792:0@lo:104: 00000100:00100000:3.0:1787378032.832593:0:6268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378032.832700:0:6268:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ddd85837 going to sleep for 11 seconds 00000100:00100000:1.0:1787378032.836570:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626545792 00000100:00100000:1.0:1787378032.836587:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626545792 00000100:00100000:1.0:1787378032.836701:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787378032.836711:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaf0292f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:6268:x1874201626545792:12345-0@lo:104: 00010000:00010000:1.0:1787378032.836761:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378032.836870:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378032.836876:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaf0292f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:6268:x1874201626545792:12345-0@lo:104: Request processed in 168us (4284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378032.836884:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787378032.836958:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378032.836964:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.836971:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d5b7fee6 already unused, calling callback (00000000548bd61c) 10000000:00010000:0.0:1787378032.836975:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.836983:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787378032.836989:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378032.836995:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787378032.837035:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837043:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787378032.837062:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837067:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000d5b7fee6/0xdd3c5462d78529cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529d3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837087:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378032.837094:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378032.837096:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378032.837119:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626545920:0@lo:103: 00000100:00100000:0.0:1787378032.837182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378032.837235:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626545920 00000100:00100000:0.0:1787378032.837239:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626545920 00010000:00010000:0.0:1787378032.837258:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 12 pid: 5783 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378032.837280:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787378032.837285:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e10759 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3314:x1874201626545920:12345-0@lo:103: 00010000:00010000:0.0:1787378032.837296:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378032.837299:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 12 pid: 5783 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837309:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 12 pid: 5783 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837324:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837331:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837345:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837364:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837370:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837395:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837400:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000acc8d363 already unused, calling callback (00000000e02d88ef) 00010000:00010000:0.0:1787378032.837404:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837411:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837419:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378032.837427:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378032.837455:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e10759 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3314:x1874201626545920:12345-0@lo:103: Request processed in 170us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378032.837461:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787378032.837500:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626545920:0@lo:103: 00010000:00010000:3.0:1787378032.838571:0:6268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000024ad8ac0/0xdd3c5462d78529d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d78529cc expref: 11 pid: 5783 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378032.838587:0:6268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000741fd54e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6268:1874201626545792:0@lo:104: 00010000:00010000:3.0:1787378032.838609:0:6268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378032.838617:0:6268:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378032.838622:0:6268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378032.838627:0:6268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000acc8d363/0xdd3c5462d7852a12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378033.626497:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378033.690029:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008afcf9aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626546048:0@lo:400: 00000100:00100000:2.0:1787378033.690525:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378033.693068:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626546048 00000100:00100000:1.0:1787378033.693080:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626546048 00000100:00100000:1.0:1787378033.693192:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787378033.693200:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee0afe78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626546048:12345-0@lo:400: 00000100:00100000:1.0:1787378033.693280:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee0afe78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626546048:12345-0@lo:400: Request processed in 81us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378033.693288:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787378033.696143:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008afcf9aa x1874201626546048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378033.696164:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008afcf9aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626546048:0@lo:400: 00010000:00010000:0.0:1787378034.650739:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378035.676769:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787378035.865829:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787378035.865837:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb8a31b800 from 1 10000000:01000000:0.0:1787378035.865843:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787378035.865886:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000063945c93/0xdd3c5462d7852a19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378035.865905:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000063945c93/0xdd3c5462d7852a19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378035.865934:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000063945c93/0xdd3c5462d7852a19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378035.865959:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626546176:0@lo:101: 00000100:00100000:0.0:1787378035.866030:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378035.866087:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b81a63c going to sleep for 11 seconds 00000100:00100000:1.0:1787378035.866149:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626546176 00000100:00100000:1.0:1787378035.866157:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626546176 00000100:00100000:1.0:1787378035.866222:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787378035.866235:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe42371f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:5788:x1874201626546176:12345-0@lo:101: 00010000:00010000:1.0:1787378035.866251:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378035.866269:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000912bd19e/0xdd3c5462d7852a20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852a19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378035.866302:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000912bd19e/0xdd3c5462d7852a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378035.866315:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000912bd19e/0xdd3c5462d7852a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378035.866328:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000912bd19e, rc 0) 00000100:00100000:1.0:1787378035.866399:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe42371f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626546176:12345-0@lo:101: Request processed in 169us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378035.866418:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787378035.866520:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626546176:0@lo:101: 00010000:00010000:0.0:1787378035.866534:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000063945c93/0xdd3c5462d7852a19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378035.866542:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000063945c93/0xdd3c5462d7852a19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378035.866597:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626546304:0@lo:501: 00000100:00100000:0.0:1787378035.866638:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378035.866658:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b81a63c going to sleep for 11 seconds 00000100:00100000:1.0:1787378035.866704:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626546304 00000100:00100000:1.0:1787378035.866709:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626546304 00000100:00100000:1.0:1787378035.866765:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787378035.866771:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc4d02a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626546304:12345-0@lo:501: 00000100:00100000:1.0:1787378035.866977:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc4d02a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626546304:12345-0@lo:501: Request processed in 206us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378035.866985:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787378035.867067:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626546304:0@lo:501: 00000100:00100000:0.0:1787378035.867105:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626546432:0@lo:503: 00000100:00100000:0.0:1787378035.867139:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378035.867166:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b81a63c going to sleep for 11 seconds 00000100:00100000:1.0:1787378035.867209:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626546432 00000100:00100000:1.0:1787378035.867213:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626546432 00000100:00100000:1.0:1787378035.867242:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787378035.867247:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9a8de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626546432:12345-0@lo:503: 00000100:00100000:1.0:1787378035.867433:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9a8de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626546432:12345-0@lo:503: Request processed in 185us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378035.867440:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787378035.867908:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626546432:0@lo:503: 00000100:00100000:0.0:1787378035.868485:0:6422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6422:1874201626546560:0@lo:502: 00000100:00100000:0.0:1787378035.868533:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378035.868567:0:6422:0:(client.c:2702:ptlrpc_set_wait()) set 000000002466abba going to sleep for 11 seconds 00000100:00100000:1.0:1787378035.870043:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626546560 00000100:00100000:1.0:1787378035.870055:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626546560 00000100:00100000:1.0:1787378035.870116:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787378035.870123:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000094b5fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6422:x1874201626546560:12345-0@lo:502: 00000100:00100000:1.0:1787378035.870400:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000094b5fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6422:x1874201626546560:12345-0@lo:502: Request processed in 277us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378035.870407:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787378035.870926:0:6422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007319ff66 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6422:1874201626546560:0@lo:502: 00000020:01000000:0.0:1787378035.870970:0:6422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378035.870988:0:6422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378035.870991:0:6422:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787378035.870998:0:6422:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eeb8a31b800 00000020:00000080:0.0:1787378035.871000:0:6422:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787378035.871052:0:6422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6422:1874201626546688:0@lo:502: 00000100:00100000:0.0:1787378035.871101:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378035.871128:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626546688 00000100:00100000:0.0:1787378035.871132:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626546688 00000100:00100000:0.0:1787378035.871158:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787378035.871165:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6422:x1874201626546688:12345-0@lo:502: 00000100:00100000:0.0:1787378035.871298:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6422:x1874201626546688:12345-0@lo:502: Request processed in 133us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378035.871304:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787378035.871338:0:6422:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c5c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787378035.871349:0:6422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6422:1874201626546688:0@lo:502: 00000020:01000000:0.0:1787378035.871376:0:6422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378035.871381:0:6422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378035.871382:0:6422:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787378035.871386:0:6422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787378035.871445:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787378035.871460:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787378035.871470:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378035.871481:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378036.702647:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378037.725078:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787378038.730317:0:6584:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787378038.730321:0:6584:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787378038.730486:0:6584:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9eeb88344000 00000020:01000004:3.0:1787378038.730502:0:6584:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787378038.730514:0:6584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787378038.730540:0:6584:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9eeb91794d40) 00000020:00000080:3.0:1787378038.730558:0:6584:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:2.0:1787378038.749182:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787378038.753081:0:6584:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787378038.753529:0:6584:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00000100:00100000:0.0:1787378038.810013:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626546944:0@lo:400: 00000100:00100000:0.0:1787378038.810084:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378038.810166:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626546944 00000100:00100000:0.0:1787378038.810173:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626546944 00000100:00100000:0.0:1787378038.810213:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787378038.810221:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626546944:12345-0@lo:400: 00000100:00100000:0.0:1787378038.810282:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626546944:12345-0@lo:400: Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378038.810290:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787378038.810332:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eebaf44e300 x1874201626546944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378038.810354:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626546944:0@lo:400: 00000100:00100000:1.0:1787378038.810427:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626546816:0@lo:400: 00000100:00100000:1.0:1787378038.810463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378038.810585:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626546816 00000100:00100000:0.0:1787378038.810590:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626546816 00000100:00100000:0.0:1787378038.812766:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787378038.812789:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3312:x1874201626546816:12345-0@lo:400: 00000100:00100000:0.0:1787378038.812888:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3312:x1874201626546816:12345-0@lo:400: Request processed in 110us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378038.812896:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787378038.813781:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626546816:0@lo:400: 00100000:10000000:2.0:1787378038.822899:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787378038.834521:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787378038.834559:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787378038.834697:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787378038.834823:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787378038.835163:0:6584:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787378038.835175:0:6584:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787378038.835184:0:6584:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdd3c5462d7852a2e 00000020:01000004:2.0:1787378038.835191:0:6584:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787378038.835212:0:6584:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787378038.835215:0:6584:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787378038.835220:0:6584:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787378038.835225:0:6584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787378038.835236:0:6584:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9eeb883b3380) 00000020:00000080:2.0:1787378038.835429:0:6584:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787378038.837765:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378038.837942:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787378038.837948:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787378038.843531:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787378038.843547:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787378038.844094:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787378038.844100:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787378038.845997:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378038.846176:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787378038.846182:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787378038.849664:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787378038.849689:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787378038.888517:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378038.888787:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787378038.888793:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787378038.892547:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787378038.892565:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787378038.894204:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787378038.894215:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787378038.899700:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378038.901101:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787378038.901111:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787378038.907776:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787378038.907792:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787378039.016266:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378039.016450:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787378039.016455:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787378039.017559:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787378039.017570:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787378039.018052:0:6584:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787378039.018075:0:6584:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787378039.018081:0:6584:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787378039.047049:0:6584:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787378039.047088:0:6584:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787378039.047091:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787378039.047093:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787378039.047094:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787378039.047095:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787378039.047096:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787378039.047098:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787378039.047099:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787378039.047101:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787378039.047102:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787378039.047104:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787378039.047105:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787378039.047109:0:6584:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787378039.047111:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787378039.047113:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787378039.047114:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787378039.047115:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787378039.047116:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787378039.047117:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787378039.047118:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787378039.047119:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787378039.047120:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787378039.047120:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787378039.047122:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787378039.047231:0:6584:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787378039.047251:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626547072:0@lo:253: 00000100:00100000:2.0:1787378039.047326:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378039.047462:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb856ba780 going to sleep for 11 seconds 00000100:00100000:0.0:1787378039.047755:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626547072 00000100:00100000:0.0:1787378039.047763:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626547072 00000100:00100000:0.0:1787378039.047855:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787378039.047863:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626547072:12345-0@lo:253: 20000000:01000000:0.0:1787378039.047895:0:5786:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787378039.047899:0:5786:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787378039.047904:0:5786:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787378039.047908:0:5786:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787378039.049245:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787378039.050161:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787378039.050182:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787378039.050236:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787378039.050244:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787378039.050272:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787378039.050619:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787378039.051278:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787378039.051315:0:5786:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:1.0:1787378039.051324:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787378039.051478:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787378039.051488:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787378039.051535:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787378039.051544:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1787378039.051588:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787378039.051599:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787378039.051630:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787378039.051685:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787378039.052691:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787378039.052714:0:5786:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:1.0:1787378039.052716:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787378039.052784:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787378039.052793:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787378039.052823:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787378039.052830:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1787378039.052891:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787378039.052901:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787378039.052933:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787378039.052970:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787378039.052986:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787378039.052989:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787378039.052993:0:5786:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787378039.053005:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787378039.053007:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787378039.053040:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787378039.053042:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787378039.054590:0:6599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787378039.055030:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787378039.055076:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787378039.055146:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787378039.055161:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787378039.055163:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787378039.055712:0:6600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787378039.055855:0:6600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787378039.055922:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787378039.056215:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787378039.056257:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787378039.056293:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787378039.056305:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787378039.056307:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787378039.057986:0:6601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787378039.058086:0:6601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787378039.058234:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787378039.059105:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787378039.059297:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787378039.059513:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787378039.059532:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787378039.059534:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787378039.059542:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787378039.059566:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.059585:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852955 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d785294e expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.059592:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d785296a expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.059599:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d78529e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d78529da expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.059606:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.059643:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d78529e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d78529da expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.059660:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d78529e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d78529da expref: 12 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.059676:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626547200:0@lo:104: 00000100:00100000:1.0:1787378039.059821:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787378039.059901:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d785296a expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.059928:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d785296a expref: 12 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.059938:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626547328:0@lo:104: 00000100:00100000:1.0:1787378039.059962:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787378039.060042:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d785294e expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.060051:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852955 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d785294e expref: 12 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.060059:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626547456:0@lo:104: 00000100:00100000:1.0:1787378039.060079:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378039.060231:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626547200 00000100:00100000:2.0:1787378039.060240:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626547200 00000100:00100000:2.0:1787378039.060277:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626547328 00000100:00100000:2.0:1787378039.060280:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626547328 00000100:00100000:2.0:1787378039.060293:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787378039.060301:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:5786:x1874201626547200:12345-0@lo:104: 00010000:00010000:2.0:1787378039.060313:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d78529da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.060392:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787378039.060399:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:5786:x1874201626547200:12345-0@lo:104: Request processed in 99us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378039.060405:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787378039.060421:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378039.060427:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5786:x1874201626547328:12345-0@lo:104: 00010000:00010000:2.0:1787378039.060434:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d785296a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.060480:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1787378039.060484:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1787378039.060485:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5786:x1874201626547328:12345-0@lo:104: Request processed in 59us (523us total) trans 0 rc 0/0 00010000:00010000:3.0:1787378039.060491:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d78529da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378039.060491:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787378039.060499:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485c00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378039.060503:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d78529da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.060505:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378039.060511:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d78529da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378039.060529:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d78529da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378039.060535:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787378039.060576:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d78529da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.060582:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787378039.060599:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d78529da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.060606:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d78529da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d78529e1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.060619:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378039.060621:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378039.060622:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378039.060626:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.060646:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626547200:0@lo:104: 00000100:00100000:1.0:1787378039.060654:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626547328:0@lo:104: 00000100:00100000:2.0:1787378039.060713:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626547456 00000100:00100000:2.0:1787378039.060717:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626547456 00000100:00100000:2.0:1787378039.060757:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787378039.060763:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5786:x1874201626547456:12345-0@lo:104: 00010000:00010000:2.0:1787378039.060770:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d785294e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.060816:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787378039.060822:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5786:x1874201626547456:12345-0@lo:104: Request processed in 59us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378039.060828:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787378039.060887:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626547456:0@lo:104: 00010000:00010000:1.0:1787378039.060908:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.060998:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378039.061003:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d785294e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.061009:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546c00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378039.061013:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d785294e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.061020:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d785294e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378039.061027:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d785294e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378039.061041:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787378039.061065:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626547584:0@lo:103: 00010000:00010000:3.0:1787378039.061068:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d785294e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.061074:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787378039.061098:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d785294e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378039.061099:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787378039.061105:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d785294e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852955 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.061114:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378039.061116:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378039.061117:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378039.061124:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787378039.061132:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626547712:0@lo:103: 00000100:00100000:0.0:1787378039.061137:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626547584 00000100:00100000:0.0:1787378039.061141:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626547584 00000100:00100000:3.0:1787378039.061157:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787378039.062687:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d78529e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d78529da expref: 13 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.062879:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378039.062882:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378039.062884:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378039.062973:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d785296a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.062982:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546e00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:2.0:1787378039.062986:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d785296a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.062993:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d785296a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787378039.063000:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d785296a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378039.063015:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787378039.063061:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d785296a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.063067:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787378039.063068:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626547712 00000100:00100000:1.0:1787378039.063075:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626547712 00010000:00010000:2.0:1787378039.063085:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d785296a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.063092:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d785296a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852971 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063108:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852955 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d785294e expref: 14 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.063109:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378039.063111:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378039.063112:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378039.063126:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787378039.063127:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626547840:0@lo:103: 00000100:00100000:1.0:1787378039.063133:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:3314:x1874201626547584:12345-0@lo:103: 00000100:00100000:2.0:1787378039.063179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787378039.063278:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378039.063286:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d78529e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d78529da expref: 14 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063298:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d78529e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d78529da expref: 14 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063313:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d78529e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d78529da expref: 14 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063327:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378039.063382:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787378039.063390:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787378039.063542:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3314:x1874201626547584:12345-0@lo:103: Request processed in 408us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.063549:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787378039.063567:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626547840 00000100:00100000:1.0:1787378039.063570:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626547840 00000100:00100000:2.0:1787378039.063579:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626547584:0@lo:103: 00010000:00010000:1.0:1787378039.063582:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d785296a expref: 13 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.063594:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787378039.063599:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3312:x1874201626547712:12345-0@lo:103: 00010000:00010000:1.0:1787378039.063615:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378039.063621:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852955 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d785294e expref: 13 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063629:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d785294e expref: 13 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063638:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852955 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d785294e expref: 13 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063657:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378039.063692:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3312:x1874201626547712:12345-0@lo:103: Request processed in 92us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.063698:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378039.063708:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626547712:0@lo:103: 00000100:00100000:1.0:1787378039.063712:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787378039.063731:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:3312:x1874201626547840:12345-0@lo:103: 00010000:00010000:1.0:1787378039.063740:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378039.063745:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d785296a expref: 11 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063754:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d785296a expref: 11 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063764:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d785296a expref: 11 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063776:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063784:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063796:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063803:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063810:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063823:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063828:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378039.063832:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063839:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063861:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.063871:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378039.063901:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:3312:x1874201626547840:12345-0@lo:103: Request processed in 183us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.063907:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787378039.063922:0:5786:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.063931:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.063931:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626547840:0@lo:103: 00010000:00010000:2.0:1787378039.063937:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787378039.063949:0:5786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787378039.133313:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:6584:x1874201626547072:12345-0@lo:253: Request processed in 85442us (85978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378039.133326:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787378039.133509:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626547072:0@lo:253: 10000000:01000000:2.0:1787378039.133525:0:6584:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787378039.133528:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787378039.133530:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787378039.133531:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787378039.133533:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787378039.133534:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787378039.133535:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787378039.133537:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787378039.133538:0:6584:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787378039.133539:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787378039.133541:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787378039.133558:0:6584:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eeb88344000 from lustre-OST0000 10000000:01000000:2.0:1787378039.133582:0:6584:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787378039.133584:0:6584:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787378039.133590:0:6584:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eeb882799c0 local copy 10000000:01000000:2.0:1787378039.133657:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787378039.133691:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.133703:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.133712:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378039.133757:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626547968:0@lo:101: 00000100:00100000:2.0:1787378039.133789:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378039.134014:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf7173c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378039.134186:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626547968 00000100:00100000:0.0:1787378039.134193:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626547968 00000100:00100000:0.0:1787378039.134235:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787378039.134243:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:6584:x1874201626547968:12345-0@lo:101: 00010000:00010000:0.0:1787378039.134257:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378039.134271:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128a200/0xdd3c5462d7852a4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852a43 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.134292:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128a200/0xdd3c5462d7852a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852a43 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.134302:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128a200/0xdd3c5462d7852a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a43 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.134312:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a200, rc 0) 00000100:00100000:0.0:1787378039.134564:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:6584:x1874201626547968:12345-0@lo:101: Request processed in 320us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378039.134570:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787378039.134683:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626547968:0@lo:101: 00010000:00010000:2.0:1787378039.134696:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.134715:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378039.136988:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548096:0@lo:501: 00000100:00100000:3.0:1787378039.137241:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378039.137286:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf7173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378039.137353:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626548096 00000100:00100000:2.0:1787378039.137360:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626548096 00000100:00100000:2.0:1787378039.137425:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787378039.137433:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:6584:x1874201626548096:12345-0@lo:501: 00000100:00100000:2.0:1787378039.137662:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:6584:x1874201626548096:12345-0@lo:501: Request processed in 229us (421us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787378039.137671:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787378039.137885:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548096:0@lo:501: 10000000:01000000:3.0:1787378039.137908:0:6584:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787378039.137942:0:6584:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787378039.137957:0:6584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.137967:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.137973:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.138003:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787378039.138027:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eeb88344000 10000000:01000000:3.0:1787378039.138032:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787378039.138037:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9eeb882799c0 10000000:01000000:3.0:1787378039.138040:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787378039.138043:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9eeb882799c0 from 1 10000000:01000000:3.0:1787378039.138047:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787378039.138079:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.138087:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.138096:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378039.138116:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548224:0@lo:101: 00000100:00100000:3.0:1787378039.138148:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378039.138180:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd180 going to sleep for 11 seconds 00010000:00010000:0.0:1787378039.138298:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378039.138305:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.138313:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7200 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:0.0:1787378039.138317:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.138326:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787378039.138345:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378039.138351:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787378039.138370:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.138376:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787378039.138396:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.138404:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7200/0xdd3c5462d7852a43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd3c5462d7852a4a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.138420:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378039.138421:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378039.138423:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378039.138517:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626548352:0@lo:103: 00000100:00100000:3.0:1787378039.138544:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378039.138617:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626548352 00000100:00100000:0.0:1787378039.138622:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626548352 00000100:00100000:0.0:1787378039.138667:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787378039.138674:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:3313:x1874201626548352:12345-0@lo:103: 00010000:00010000:0.0:1787378039.138686:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378039.138701:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128a200/0xdd3c5462d7852a4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852a43 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.138714:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378039.138779:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:3313:x1874201626548352:12345-0@lo:103: Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378039.138786:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378039.138977:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626548224 00000100:00100000:2.0:1787378039.138982:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626548224 00000100:00100000:2.0:1787378039.139015:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787378039.139022:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:6584:x1874201626548224:12345-0@lo:101: 00010000:00010000:2.0:1787378039.139033:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378039.139045:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c7800/0xdd3c5462d7852a58 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852a51 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.139061:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c7800/0xdd3c5462d7852a58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852a51 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.139072:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c7800/0xdd3c5462d7852a58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a51 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.139078:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7800, rc 0) 00000100:00100000:2.0:1787378039.139111:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:6584:x1874201626548224:12345-0@lo:101: Request processed in 89us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378039.139123:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787378039.139259:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626548352:0@lo:103: 00000100:00100000:3.0:1787378039.139290:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548224:0@lo:101: 00010000:00010000:3.0:1787378039.139303:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a58 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.139313:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852a58 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378039.139327:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787378039.139353:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a58 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.139362:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a58 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378039.139369:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787378039.139374:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787378039.139378:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787378039.139380:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787378039.139395:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.139403:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.139411:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378039.139424:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548480:0@lo:101: 00000100:00100000:3.0:1787378039.139457:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378039.139484:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.139605:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626548480 00000100:00100000:1.0:1787378039.139610:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626548480 00000100:00100000:1.0:1787378039.139640:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787378039.139646:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+10:6584:x1874201626548480:12345-0@lo:101: 00010000:00010000:1.0:1787378039.139654:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378039.139664:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852a5f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.139677:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.139696:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.139702:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81484200, rc 0) 00000100:00100000:1.0:1787378039.139765:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548480:12345-0@lo:101: Request processed in 119us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.139771:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787378039.139962:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548480:0@lo:101: 00010000:00010000:3.0:1787378039.139974:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.139982:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378039.140066:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548608:0@lo:501: 00000100:00100000:3.0:1787378039.140094:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378039.140120:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787378039.140196:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626548608 00000100:00100000:0.0:1787378039.140200:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626548608 00000100:00100000:0.0:1787378039.140221:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787378039.140228:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548608:12345-0@lo:501: 00000100:00100000:0.0:1787378039.140453:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548608:12345-0@lo:501: Request processed in 225us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378039.140460:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787378039.140603:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548608:0@lo:501: 00000100:00100000:3.0:1787378039.140631:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548736:0@lo:503: 00000100:00100000:3.0:1787378039.140669:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378039.140689:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.140863:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626548736 00000100:00100000:1.0:1787378039.140868:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626548736 00000100:00100000:1.0:1787378039.140899:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787378039.140906:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548736:12345-0@lo:503: 00000100:00100000:1.0:1787378039.141075:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548736:12345-0@lo:503: Request processed in 169us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.141082:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787378039.141555:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548736:0@lo:503: 00000040:00080000:2.0:1787378039.142015:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787378039.142093:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548864:0@lo:502: 00000100:00100000:2.0:1787378039.142152:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378039.142189:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf717c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.143952:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626548864 00000100:00100000:1.0:1787378039.143973:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626548864 00000100:00100000:1.0:1787378039.144042:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787378039.144051:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548864:12345-0@lo:502: 00000100:00100000:1.0:1787378039.144310:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548864:12345-0@lo:502: Request processed in 259us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.144318:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787378039.145229:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548864:0@lo:502: 00000040:00080000:2.0:1787378039.145555:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787378039.145633:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787378039.145669:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787378039.145716:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787378039.146101:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787378039.146136:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787378039.146176:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548992:0@lo:502: 00000100:00100000:2.0:1787378039.146244:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378039.146380:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626548992 00000100:00100000:3.0:1787378039.146386:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626548992 00000100:00100000:3.0:1787378039.146434:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787378039.146442:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548992:12345-0@lo:502: 00000100:00100000:3.0:1787378039.146613:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626548992:12345-0@lo:502: Request processed in 171us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378039.146621:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787378039.146680:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf717c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787378039.146697:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626548992:0@lo:502: 00000040:00080000:3.0:1787378039.146796:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787378039.146813:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787378039.150296:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787378039.150308:0:6604:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787378039.150315:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378039.150317:0:6604:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787378039.150325:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787378039.150350:0:6604:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9eeb877919c0) 00000020:00000080:0.0:1787378039.150370:0:6604:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787378039.150379:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787378039.150509:0:6604:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eeb88344000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787378039.150516:0:6604:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787378039.150521:0:6604:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdd3c5462d7852a74 00010000:00010000:0.0:1787378039.158929:0:6604:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787378039.160299:0:6604:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787378039.165213:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787378039.165913:0:6604:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787378039.175546:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787378039.176428:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787378039.179763:0:6604:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787378039.179777:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378039.179784:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378039.179786:0:6604:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787378039.179790:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787378039.179794:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378039.179795:0:6604:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787378039.179798:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787378039.179800:0:6604:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787378039.179934:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378039.179939:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378039.179940:0:6604:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787378039.179943:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787378039.180106:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787378039.180131:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787378039.180258:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.180271:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378039.180289:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb88344000 from 1 10000000:01000000:1.0:1787378039.180292:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787378039.180330:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.180417:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.180429:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.180450:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549120:0@lo:101: 00000100:00100000:1.0:1787378039.180517:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378039.180570:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84430780 going to sleep for 11 seconds 00000100:00100000:2.0:1787378039.180684:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626549120 00000100:00100000:2.0:1787378039.180692:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626549120 00000100:00100000:2.0:1787378039.180763:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787378039.180773:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:6584:x1874201626549120:12345-0@lo:101: 00010000:00010000:2.0:1787378039.180785:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378039.180798:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852a7b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.180821:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.181041:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.181050:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7200, rc 0) 00000100:00100000:2.0:1787378039.181147:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549120:12345-0@lo:101: Request processed in 375us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378039.181162:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787378039.181283:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549120:0@lo:101: 00010000:00010000:1.0:1787378039.181297:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.181306:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.181483:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549248:0@lo:501: 00000100:00100000:1.0:1787378039.181514:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378039.181586:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84430780 going to sleep for 11 seconds 00000100:00100000:3.0:1787378039.187543:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626549248 00000100:00100000:3.0:1787378039.187556:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626549248 00000100:00100000:3.0:1787378039.187608:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787378039.187617:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549248:12345-0@lo:501: 00000100:00100000:3.0:1787378039.187975:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549248:12345-0@lo:501: Request processed in 357us (6458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378039.187983:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787378039.188134:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549248:0@lo:501: 00000100:00100000:0.0:1787378039.188202:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549376:0@lo:503: 00000100:00100000:0.0:1787378039.188250:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378039.188293:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8516d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.189527:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626549376 00000100:00100000:1.0:1787378039.189539:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626549376 00000100:00100000:1.0:1787378039.189600:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787378039.189611:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549376:12345-0@lo:503: 00000100:00100000:1.0:1787378039.189922:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549376:12345-0@lo:503: Request processed in 312us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.189930:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787378039.190194:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549376:0@lo:503: 00000040:00080000:0.0:1787378039.190509:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787378039.190584:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549504:0@lo:502: 00000100:00100000:0.0:1787378039.190649:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378039.190679:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8516d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.191090:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626549504 00000100:00100000:1.0:1787378039.191097:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626549504 00000100:00100000:1.0:1787378039.191126:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787378039.191133:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549504:12345-0@lo:502: 00000100:00100000:1.0:1787378039.191377:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549504:12345-0@lo:502: Request processed in 242us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.191384:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787378039.191557:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549504:0@lo:502: 00000040:00080000:0.0:1787378039.192301:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787378039.192508:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787378039.192545:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549632:0@lo:502: 00000100:00100000:0.0:1787378039.192695:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378039.192753:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8516d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787378039.192784:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626549632 00000100:00100000:2.0:1787378039.192792:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626549632 00000100:00100000:2.0:1787378039.192883:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787378039.192893:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549632:12345-0@lo:502: 00000100:00100000:2.0:1787378039.193564:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549632:12345-0@lo:502: Request processed in 668us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378039.193574:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787378039.195056:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549632:0@lo:502: 00000040:00080000:0.0:1787378039.195330:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787378039.195359:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787378039.195997:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378039.196007:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378039.196010:0:6608:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787378039.196016:0:6608:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eeb88344000 00000020:00000080:0.0:1787378039.196018:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787378039.196036:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378039.196039:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378039.196051:0:6608:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787378039.196054:0:6608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787378039.196485:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787378039.196510:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787378039.196534:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.196547:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378039.196940:0:6584:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787378039.196944:0:6584:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eeb88344000 10000000:01000000:2.0:1787378039.196947:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eeb88344000 10000000:01000000:2.0:1787378039.196952:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787378039.196958:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eeb88344000 from 1 10000000:01000000:2.0:1787378039.196961:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787378039.197005:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.197014:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.197023:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378039.197043:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549760:0@lo:101: 00000100:00100000:2.0:1787378039.197104:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378039.197184:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf717cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.198328:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626549760 00000100:00100000:1.0:1787378039.198349:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626549760 00000100:00100000:1.0:1787378039.198402:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787378039.198411:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626549760:12345-0@lo:101: 00010000:00010000:1.0:1787378039.198425:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378039.198440:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852a89 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.198464:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.198476:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.198485:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81484000, rc 0) 00000100:00100000:1.0:1787378039.198546:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626549760:12345-0@lo:101: Request processed in 136us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.198552:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787378039.198711:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549760:0@lo:101: 00010000:00010000:2.0:1787378039.198751:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.198760:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378039.198877:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549888:0@lo:501: 00000100:00100000:2.0:1787378039.198905:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378039.198936:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf717cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.199178:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626549888 00000100:00100000:1.0:1787378039.199183:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626549888 00000100:00100000:1.0:1787378039.199215:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787378039.199222:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626549888:12345-0@lo:501: 00000100:00100000:1.0:1787378039.199453:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626549888:12345-0@lo:501: Request processed in 230us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.199460:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787378039.199948:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626549888:0@lo:501: 00000100:00100000:2.0:1787378039.199987:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626550016:0@lo:503: 00000100:00100000:2.0:1787378039.200029:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378039.200062:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf717cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.200112:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626550016 00000100:00100000:1.0:1787378039.200117:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626550016 00000100:00100000:1.0:1787378039.200189:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787378039.200197:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626550016:12345-0@lo:503: 00000100:00100000:1.0:1787378039.200363:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626550016:12345-0@lo:503: Request processed in 167us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.200371:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787378039.200534:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626550016:0@lo:503: 00000040:00080000:0.0:1787378039.200845:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787378039.200903:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626550144:0@lo:502: 00000100:00100000:0.0:1787378039.200940:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378039.206314:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8516d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787378039.206804:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626550144 00000100:00100000:2.0:1787378039.206816:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626550144 00000100:00100000:2.0:1787378039.206885:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787378039.206895:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626550144:12345-0@lo:502: 00000100:00100000:2.0:1787378039.207240:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626550144:12345-0@lo:502: Request processed in 345us (6297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378039.207248:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787378039.207657:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626550144:0@lo:502: 00000040:00080000:0.0:1787378039.208681:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787378039.209058:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787378039.209100:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787378039.209176:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787378039.209215:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787378039.209306:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787378039.209354:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787378039.209397:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787378039.209444:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787378039.209481:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787378039.209513:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787378039.209571:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787378039.209612:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787378039.209649:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787378039.209699:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787378039.209764:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787378039.209802:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787378039.209870:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787378039.209920:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787378039.209959:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787378039.210011:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787378039.210065:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787378039.210104:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787378039.210185:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787378039.210229:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787378039.210267:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787378039.210315:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787378039.210381:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787378039.210432:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626550272:0@lo:502: 00000100:00100000:0.0:1787378039.210507:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378039.210558:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8516d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.210829:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626550272 00000100:00100000:1.0:1787378039.210838:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626550272 00000100:00100000:1.0:1787378039.210885:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787378039.210895:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626550272:12345-0@lo:502: 00000100:00100000:1.0:1787378039.211113:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626550272:12345-0@lo:502: Request processed in 219us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.211121:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787378039.211295:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626550272:0@lo:502: 00000040:00080000:0.0:1787378039.211381:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787378039.211393:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787378039.212088:0:6609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787378039.212104:0:6609:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9eeb87790000) 00000020:00000080:0.0:1787378039.212123:0:6609:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787378039.212279:0:6609:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eeb88344000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787378039.212283:0:6609:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eeb88344000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787378039.212285:0:6609:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eeb88344000 3 00010000:00080000:0.0:1787378039.212312:0:6609:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eebbf7bf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1787378039.216650:0:6609:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787378039.216869:0:6609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787378039.216928:0:6609:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787378039.216940:0:6609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdd3c5462d7852a9e 00000100:00080000:0.0:1787378039.216950:0:6609:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787378039.216957:0:6609:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eebbf7bf000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787378039.217066:0:6609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebaf44d500 x1874201626550400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787378039.217101:0:6609:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787378039.217165:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874201626550400:0@lo:38: 00000100:00100000:3.0:1787378039.217235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378039.217304:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626550400 00000100:00100000:3.0:1787378039.217310:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626550400 00000100:00100000:3.0:1787378039.217357:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787378039.217457:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874201626550400:12345-0@lo:38: 00010000:00080000:3.0:1787378039.217482:0:5792:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:3.0:1787378039.217527:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdd3c5462d7852aa5 00000004:00100000:3.0:1787378039.217541:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787378039.217905:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9eebbf746000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787378039.217975:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874201626550400:12345-0@lo:38: Request processed in 609us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378039.217982:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787378039.218279:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eebaf44d500 x1874201626550400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787378049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378039.218291:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787378039.218299:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787378039.218306:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787378039.218311:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787378039.218330:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebbf7bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787378039.218349:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874201626550400:0@lo:38: 00000040:00080000:0.0:1787378039.220085:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787378039.220329:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787378039.220502:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787378039.220551:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.220563:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787378039.220604:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787378039.220606:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787378039.220608:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378039.220609:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378039.220610:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378039.220611:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378039.220613:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787378039.220614:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787378039.220616:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787378039.220617:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378039.220619:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787378039.220623:0:6584:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787378039.220625:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787378039.220627:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787378039.220628:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378039.220630:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378039.220631:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378039.220632:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378039.220633:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787378039.220634:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787378039.220638:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787378039.220639:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378039.220640:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787378039.220663:0:6584:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787378039.220679:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626550528:0@lo:253: 00000100:00100000:3.0:1787378039.220757:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378039.220793:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378039.221067:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626550528 00000100:00100000:1.0:1787378039.221074:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626550528 00000100:00100000:1.0:1787378039.221203:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787378039.221213:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6584:x1874201626550528:12345-0@lo:253: 20000000:01000000:1.0:1787378039.221236:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787378039.221247:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787378039.252856:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787378039.252909:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787378039.252955:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787378039.252960:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787378039.252994:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.253012:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81485200/0xdd3c5462d7852a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.253020:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.253059:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81485200/0xdd3c5462d7852a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378039.253073:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81485200/0xdd3c5462d7852a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 13 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378039.253088:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874201626550656:0@lo:104: 00000100:00100000:2.0:1787378039.253313:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378039.253429:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626550656 00000100:00100000:0.0:1787378039.253449:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626550656 00000100:00100000:0.0:1787378039.253490:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378039.253499:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5806:x1874201626550656:12345-0@lo:104: 00010000:00010000:0.0:1787378039.253511:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7e00/0xdd3c5462d7852a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378039.253565:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787378039.253572:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5806:x1874201626550656:12345-0@lo:104: Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378039.253579:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787378039.253635:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378039.253642:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7e00/0xdd3c5462d7852a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.253649:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7e00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378039.253653:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7e00/0xdd3c5462d7852a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.253662:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7e00/0xdd3c5462d7852a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378039.253669:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7e00/0xdd3c5462d7852a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378039.253674:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787378039.253708:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7e00/0xdd3c5462d7852a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.253715:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787378039.253752:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7e00/0xdd3c5462d7852a04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.253759:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7e00/0xdd3c5462d7852a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a0b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.253781:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378039.253783:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378039.253785:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378039.253801:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626550784:0@lo:103: 00000100:00100000:3.0:1787378039.253835:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378039.253960:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf717540 going to sleep for 11 seconds 00000100:00100000:2.0:1787378039.253983:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874201626550656:0@lo:104: 00010000:00010000:2.0:1787378039.254005:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.254417:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626550784 00000100:00100000:1.0:1787378039.254423:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626550784 00010000:00010000:1.0:1787378039.254445:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81485200/0xdd3c5462d7852a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 14 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378039.254532:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787378039.254539:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:3314:x1874201626550784:12345-0@lo:103: 00010000:00010000:1.0:1787378039.254550:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378039.254556:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81485200/0xdd3c5462d7852a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 14 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254565:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81485200/0xdd3c5462d7852a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 14 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254579:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81485200/0xdd3c5462d7852a0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852a04 expref: 14 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254591:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254599:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787378039.254621:0:5777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001661258s 00010000:00010000:1.0:1787378039.254625:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254632:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254639:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254646:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254652:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378039.254655:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254662:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.254861:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378039.254870:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.254996:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.255004:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852aac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378039.255016:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378039.255060:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3314:x1874201626550784:12345-0@lo:103: Request processed in 521us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378039.255067:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787378039.255079:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626550784:0@lo:103: 00000100:00100000:3.0:1787378039.261923:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:6584:x1874201626550528:12345-0@lo:253: Request processed in 40700us (41155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378039.261937:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787378039.262057:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6584:1874201626550528:0@lo:253: 10000000:01000000:2.0:1787378039.262072:0:6584:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787378039.262076:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787378039.262078:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787378039.262079:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787378039.262081:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787378039.262082:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787378039.262084:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787378039.262086:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787378039.262087:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787378039.262089:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787378039.262090:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787378039.262091:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787378039.262240:0:6584:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787378039.269389:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378039.270124:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378039.270385:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378039.271114:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378039.271360:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378039.271613:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787378039.273109:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787378039.568257:0:6584:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787378039.568264:0:6584:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787378039.568293:0:6584:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787378039.568357:0:6584:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787378039.568372:0:6584:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787378039.568399:0:6584:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787378039.776538:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378040.794135:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378041.820862:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378042.842960:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378043.865960:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787378043.930755:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787378043.930763:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eeb8a31b800 from 21 10000000:01000000:0.0:1787378043.930769:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787378043.930813:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378043.930825:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378043.930836:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378043.930870:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626550912:0@lo:101: 00000100:00100000:0.0:1787378043.930936:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378043.931667:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c59780 going to sleep for 11 seconds 00000100:00100000:3.0:1787378043.935100:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626550912 00000100:00100000:3.0:1787378043.935116:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626550912 00000100:00100000:3.0:1787378043.935187:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787378043.935197:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626550912:12345-0@lo:101: 00010000:00010000:3.0:1787378043.935214:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378043.935233:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852ab3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378043.935262:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378043.935275:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378043.935296:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546800, rc 0) 00000100:00100000:3.0:1787378043.935385:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626550912:12345-0@lo:101: Request processed in 189us (4448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378043.935392:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787378043.935448:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626550912:0@lo:101: 00010000:00010000:3.0:1787378043.935465:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378043.935475:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378043.935541:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551040:0@lo:501: 00000100:00100000:3.0:1787378043.935572:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378043.935735:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787378043.938687:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626551040 00000100:00100000:0.0:1787378043.938699:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626551040 00000100:00100000:0.0:1787378043.938761:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787378043.938771:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626551040:12345-0@lo:501: 00000100:00100000:0.0:1787378043.939161:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626551040:12345-0@lo:501: Request processed in 389us (3587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378043.939168:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787378043.939358:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551040:0@lo:501: 00000100:00100000:2.0:1787378043.939414:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551168:0@lo:503: 00000100:00100000:2.0:1787378043.939455:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378043.939483:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787378043.939536:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626551168 00000100:00100000:0.0:1787378043.939541:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626551168 00000100:00100000:0.0:1787378043.939572:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787378043.940421:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb87629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626551168:12345-0@lo:503: 00000100:00100000:0.0:1787378043.940989:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb87629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626551168:12345-0@lo:503: Request processed in 575us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378043.940999:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787378043.948955:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551168:0@lo:503: 00000100:00100000:0.0:1787378043.952928:0:6888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6888:1874201626551296:0@lo:502: 00000100:00100000:0.0:1787378043.953017:0:6888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378043.953112:0:6888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c59600 going to sleep for 11 seconds 00000100:00100000:3.0:1787378043.955295:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626551296 00000100:00100000:3.0:1787378043.955323:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626551296 00000100:00100000:3.0:1787378043.955593:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787378043.955605:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6888:x1874201626551296:12345-0@lo:502: 00000100:00100000:3.0:1787378043.955962:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6888:x1874201626551296:12345-0@lo:502: Request processed in 359us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378043.955970:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787378043.956071:0:6888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6888:1874201626551296:0@lo:502: 00000100:00100000:2.0:1787378043.956137:0:6888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6888:1874201626551424:0@lo:502: 00000100:00100000:2.0:1787378043.956182:0:6888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378043.963536:0:6888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787378043.963728:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626551424 00000100:00100000:0.0:1787378043.963737:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626551424 00000100:00100000:0.0:1787378043.963791:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787378043.963800:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb87628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6888:x1874201626551424:12345-0@lo:502: 00000100:00100000:0.0:1787378043.964055:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb87628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:6888:x1874201626551424:12345-0@lo:502: Request processed in 255us (7871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378043.964068:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787378043.964174:0:6888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6888:1874201626551424:0@lo:502: 00000040:00080000:2.0:1787378043.964207:0:6888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787378043.964435:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787378043.964458:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787378043.964468:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378043.964479:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378043.964488:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787378043.964491:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9eeb8a31b800 from 4 10000000:01000000:0.0:1787378043.964494:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787378043.964527:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378043.964536:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378043.964544:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378043.964561:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551552:0@lo:101: 00000100:00100000:0.0:1787378043.964672:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378043.964704:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c59e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378043.964809:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626551552 00000100:00100000:3.0:1787378043.964815:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626551552 00000100:00100000:3.0:1787378043.964847:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787378043.964854:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626551552:12345-0@lo:101: 00010000:00010000:3.0:1787378043.964863:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378043.964882:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852ac1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378043.964902:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378043.964911:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378043.964919:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547400, rc 0) 00000100:00100000:3.0:1787378043.964953:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626551552:12345-0@lo:101: Request processed in 99us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378043.964959:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787378043.965038:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551552:0@lo:101: 00010000:00010000:2.0:1787378043.965049:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378043.965063:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378043.965103:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551680:0@lo:256: 00000100:00100000:2.0:1787378043.965131:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378043.965148:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787378043.965186:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626551680 00000100:00100000:0.0:1787378043.965190:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626551680 00000100:00100000:0.0:1787378043.965216:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787378043.965222:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626551680:12345-0@lo:256: 20000000:01000000:0.0:1787378043.965234:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787378043.965252:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787378043.965255:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787378043.965340:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626551680:12345-0@lo:256: Request processed in 117us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378043.965346:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787378043.965431:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551680:0@lo:256: 10000000:01000000:2.0:1787378043.965467:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787378043.965473:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378043.965481:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378043.965487:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787378043.965489:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787378043.965491:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787378043.965506:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378043.965513:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378043.965520:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378043.965530:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551808:0@lo:101: 00000100:00100000:2.0:1787378043.965561:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378043.965660:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626551808 00000100:00100000:0.0:1787378043.965664:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626551808 00000100:00100000:0.0:1787378043.965691:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787378043.965697:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626551808:12345-0@lo:101: 00010000:00010000:0.0:1787378043.965704:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378043.965713:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852acf expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378043.965747:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378043.965755:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378043.965761:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128bc00, rc 0) 00000100:00100000:0.0:1787378043.965782:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626551808:12345-0@lo:101: Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378043.965787:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787378043.965849:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378043.965861:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551808:0@lo:101: 00010000:00010000:2.0:1787378043.965870:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378043.965878:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378043.965915:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551936:0@lo:501: 00000100:00100000:2.0:1787378043.965951:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378043.965967:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378043.966014:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626551936 00000100:00100000:3.0:1787378043.966018:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626551936 00000100:00100000:3.0:1787378043.966045:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787378043.966051:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626551936:12345-0@lo:501: 00000100:00100000:3.0:1787378043.966313:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626551936:12345-0@lo:501: Request processed in 250us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378043.966321:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787378043.966388:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626551936:0@lo:501: 00000100:00100000:2.0:1787378043.966414:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626552064:0@lo:503: 00000100:00100000:2.0:1787378043.966450:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378043.966472:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378043.966516:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626552064 00000100:00100000:3.0:1787378043.966521:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626552064 00000100:00100000:3.0:1787378043.966547:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787378043.966554:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626552064:12345-0@lo:503: 00000100:00100000:3.0:1787378043.968045:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626552064:12345-0@lo:503: Request processed in 1484us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378043.968056:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787378043.968129:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626552064:0@lo:503: 00000100:00100000:3.0:1787378043.968362:0:6889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6889:1874201626552192:0@lo:502: 00000100:00100000:3.0:1787378043.968401:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378043.968420:0:6889:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8938d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787378043.973653:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626552192 00000100:00100000:0.0:1787378043.973667:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626552192 00000100:00100000:0.0:1787378043.973736:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787378043.973746:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:6889:x1874201626552192:12345-0@lo:502: 00000100:00100000:0.0:1787378043.974088:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:6889:x1874201626552192:12345-0@lo:502: Request processed in 343us (5685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378043.974106:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787378043.974171:0:6889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6889:1874201626552192:0@lo:502: 00000020:01000000:0.0:1787378043.974204:0:6889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787378043.974212:0:6889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787378043.974219:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378043.974222:0:6889:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787378043.974227:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787378043.974231:0:6889:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:0.0:1787378043.974253:0:6889:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787378043.974255:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787378043.974271:0:6889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9eeb87794d40) 00000020:00000080:0.0:1787378043.974290:0:6889:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787378043.974295:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787378043.974378:0:6889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787378043.974383:0:6889:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787378043.974389:0:6889:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7852ae4 00010000:00080000:0.0:1787378043.974425:0:6889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eeb87682000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1787378043.974633:0:6889:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787378044.033459:0:6889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787378044.033481:0:6889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787378044.034122:0:6889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787378044.034273:0:6889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787378044.034333:0:6889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787378044.034388:0:6889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787378044.034868:0:6892:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787378044.034873:0:6892:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787378044.035369:0:6889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787378044.035380:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787378044.035410:0:6889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787378044.035430:0:6889:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7852aeb 00000100:00080000:2.0:1787378044.035440:0:6889:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787378044.035445:0:6889:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eeb87682000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787378044.035479:0:6889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eeb9a238e00 x1874201626552320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787378044.035508:0:6889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787378044.035558:0:6889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378044.035568:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378044.035570:0:6889:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787378044.035574:0:6889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378044.035578:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378044.035579:0:6889:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787378044.035583:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787378044.035585:0:6889:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787378044.035611:0:6889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6889:1874201626552448:0@lo:502: 00000100:00100000:2.0:1787378044.035686:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378044.035749:0:6889:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf5746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378044.035773:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626552448 00000100:00100000:2.0:1787378044.035780:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626552448 00000100:00100000:2.0:1787378044.035817:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787378044.035826:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:6889:x1874201626552448:12345-0@lo:502: 00000100:00100000:2.0:1787378044.036024:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:6889:x1874201626552448:12345-0@lo:502: Request processed in 198us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378044.036032:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787378044.036180:0:6889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:6889:1874201626552448:0@lo:502: 00000020:01000000:2.0:1787378044.036205:0:6889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378044.036210:0:6889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378044.036212:0:6889:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787378044.036215:0:6889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1787378044.036483:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626552320:0@lo:8: 00000100:00100000:0.0:1787378044.036522:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378044.036981:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626552576:0@lo:400: 00000100:00100000:2.0:1787378044.037016:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378044.037042:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378044.037048:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626552704:0@lo:400: 00000100:00100000:2.0:1787378044.037071:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378044.037214:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626552320 00000100:00100000:2.0:1787378044.037221:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626552320 00000100:00100000:2.0:1787378044.037260:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378044.037266:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874201626552320:12345-0@lo:8: 00010000:00080000:2.0:1787378044.037293:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:2.0:1787378044.037331:0:6586:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7852af2 00002000:00100000:2.0:1787378044.037368:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9eebbf7ba000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113675 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787378044.037372:0:6586:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787378044.037376:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787378044.037489:0:6586:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787378044.037645:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787378044.037671:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eebbf7bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378044.037762:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874201626552320:12345-0@lo:8: Request processed in 495us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378044.037770:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378044.037801:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626552576 00000100:00100000:2.0:1787378044.037805:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626552576 00000100:00100000:2.0:1787378044.037833:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626552704 00000100:00100000:2.0:1787378044.037836:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626552704 00000100:00100000:2.0:1787378044.037861:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787378044.037868:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626552576:12345-0@lo:400: 00000100:00100000:2.0:1787378044.037907:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626552576:12345-0@lo:400: Request processed in 40us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378044.037913:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787378044.037924:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378044.037930:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626552704:12345-0@lo:400: 00000100:00100000:2.0:1787378044.037952:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626552704:12345-0@lo:400: Request processed in 23us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378044.037957:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787378044.037981:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787378044.038014:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a238e00 x1874201626552320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787378054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378044.038026:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787378044.038034:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787378044.038041:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787378044.038046:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787378044.038048:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eeb87682000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787378044.038060:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787378044.038065:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626552320:0@lo:8: 00010000:00080000:2.0:1787378044.039328:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebaf44c000 x1874201626552704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378044.039343:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626552704:0@lo:400: 00010000:00080000:2.0:1787378044.039355:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebaf44f480 x1874201626552576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378044.039363:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626552576:0@lo:400: 00000004:00080000:2.0:1787378044.039509:0:6892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787378044.039600:0:6892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 180301879598ns, next at 0ns, rc = 0 00000020:01000000:3.0:1787378044.040380:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787378044.040410:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787378044.040421:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378044.040433:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378044.040442:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787378044.040445:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9eeb882799c0 from 1 10000000:01000000:3.0:1787378044.040448:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787378044.040482:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378044.040490:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378044.040501:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378044.040521:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626552832:0@lo:101: 00000100:00100000:3.0:1787378044.040664:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378044.040707:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8938d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378044.043741:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626552832 00000100:00100000:0.0:1787378044.043765:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626552832 00000100:00100000:0.0:1787378044.043825:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787378044.043834:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626552832:12345-0@lo:101: 00010000:00010000:0.0:1787378044.043851:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378044.043870:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852af9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378044.043899:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378044.043911:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378044.043920:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128be00, rc 0) 00000100:00100000:0.0:1787378044.043993:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626552832:12345-0@lo:101: Request processed in 158us (3327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378044.044000:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787378044.044776:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626552832:0@lo:101: 00010000:00010000:3.0:1787378044.044796:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378044.044818:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378044.044943:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626552960:0@lo:501: 00000100:00100000:3.0:1787378044.044981:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378044.045016:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8938d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378044.046197:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626552960 00000100:00100000:1.0:1787378044.046207:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626552960 00000100:00100000:1.0:1787378044.046255:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787378044.046263:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626552960:12345-0@lo:501: 00000100:00100000:1.0:1787378044.046513:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626552960:12345-0@lo:501: Request processed in 249us (1530us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787378044.046522:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787378044.046570:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626552960:0@lo:501: 10000000:01000000:1.0:1787378044.046609:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787378044.046619:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378044.046629:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787378044.103074:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787378044.107780:0:6893:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787378044.107810:0:6893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6893:1874201626553216:0@lo:7: 00000100:00100000:3.0:1787378044.107880:0:6893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378044.107931:0:6893:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8938d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378044.107954:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626553088:0@lo:13: 00000100:00100000:3.0:1787378044.107980:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378044.108031:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626553216 00000100:00100000:3.0:1787378044.108038:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626553216 00000100:00100000:3.0:1787378044.108088:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787378044.108097:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6893:x1874201626553216:12345-0@lo:7: 00000100:00100000:1.0:1787378044.108411:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626553088 00000100:00100000:1.0:1787378044.108417:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626553088 00000100:00100000:1.0:1787378044.108444:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787378044.108450:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626553088:12345-0@lo:13: 00002000:00000024:1.0:1787378044.108473:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787378044.108521:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626553088:12345-0@lo:13: Request processed in 69us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378044.108537:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787378044.108647:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebade82300 x1874201626553088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378044.108665:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626553088:0@lo:13: 00000100:00080000:2.0:1787378044.110711:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787378044.112951:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787378044.112959:0:6589:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787378044.113054:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6893:x1874201626553216:12345-0@lo:7: Request processed in 4954us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378044.113064:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787378044.113314:0:6893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebade83800 x1874201626553216/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787378060 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378044.113329:0:6893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6893:1874201626553216:0@lo:7: 00000004:00080000:2.0:1787378044.113344:0:6893:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787378044.113387:0:6893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6893:1874201626553344:0@lo:5: 00000100:00100000:2.0:1787378044.113421:0:6893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378044.113471:0:6893:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574600 going to sleep for 11 seconds 00000100:00100000:3.0:1787378044.113521:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626553344 00000100:00100000:3.0:1787378044.113527:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626553344 00000100:00100000:3.0:1787378044.113640:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787378044.113649:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6893:x1874201626553344:12345-0@lo:5: 00002000:00080000:3.0:1787378044.113669:0:6588:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787378044.113677:0:6588:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787378044.113923:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6893:x1874201626553344:12345-0@lo:5: Request processed in 274us (500us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787378044.113929:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787378044.114072:0:6893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a238e00 x1874201626553344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787378060 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378044.114084:0:6893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6893:1874201626553344:0@lo:5: 00000004:00080000:3.0:1787378044.114092:0:6893:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787378044.114116:0:6893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6893:1874201626553472:0@lo:700: 00000100:00100000:3.0:1787378044.114140:0:6893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378044.114165:0:6893:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8938dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787378044.114219:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626553472 00000100:00100000:2.0:1787378044.114223:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626553472 00000100:00100000:2.0:1787378044.114254:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378044.114261:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6893:x1874201626553472:12345-0@lo:700: 00000100:00100000:2.0:1787378044.114286:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6595:1874201626553600:0@lo:700: 00000100:00100000:2.0:1787378044.114322:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378044.114336:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787378044.114386:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626553600 00000100:00100000:3.0:1787378044.114390:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626553600 00000100:00100000:3.0:1787378044.114420:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787378044.114427:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6595:x1874201626553600:12345-0@lo:700: 40000000:02000000:3.0:1787378044.182370:0:5797:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787378044.188959:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6595:x1874201626553600:12345-0@lo:700: Request processed in 74524us (74627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378044.188974:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787378044.189046:0:6595:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a23a680 x1874201626553600/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787378060 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378044.189061:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6595:1874201626553600:0@lo:700: 40000000:02000000:2.0:1787378044.189074:0:6595:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1787378044.293504:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6893:x1874201626553472:12345-0@lo:700: Request processed in 179233us (179352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378044.293521:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:3.0:1787378044.294463:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787378044.294480:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:0.0:1787378044.297610:0:6893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebade83800 x1874201626553472/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787378060 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378044.297631:0:6893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6893:1874201626553472:0@lo:700: 00000004:02000040:0.0:1787378044.347171:0:6893:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787378044.351329:0:6893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6893:1874201626553728:0@lo:5: 00000100:00100000:1.0:1787378044.351398:0:6893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378044.351522:0:6893:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9e11e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787378044.356168:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626553728 00000100:00100000:3.0:1787378044.356180:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626553728 00000100:00100000:3.0:1787378044.356240:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787378044.356249:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6893:x1874201626553728:12345-0@lo:5: 00002000:00080000:3.0:1787378044.361093:0:6586:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787378044.361122:0:6586:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787378044.364269:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6893:x1874201626553728:12345-0@lo:5: Request processed in 8013us (12864us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787378044.364281:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787378044.364526:0:6893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae98a680 x1874201626553728/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787378060 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378044.364539:0:6893:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787378044.364554:0:6893:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9eebae98a680 x1874201626553728/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787378060 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378044.364565:0:6893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6893:1874201626553728:0@lo:5: 00000004:00080000:0.0:1787378044.364584:0:6893:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787378044.889963:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787378044.938417:0:6957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787378045.926692:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378046.940011:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378047.962145:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378048.986457:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378049.050947:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626553856:0@lo:400: 00000100:00100000:0.0:1787378049.051048:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378049.051303:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626554240:0@lo:400: 00000100:00100000:2.0:1787378049.051336:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378049.051398:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626553984:0@lo:400: 00000100:00100000:2.0:1787378049.051425:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378049.051443:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378049.051448:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626554112:0@lo:400: 00000100:00100000:2.0:1787378049.051466:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378049.051496:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626554240 00000100:00100000:2.0:1787378049.051515:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626554240 00000100:00100000:2.0:1787378049.051566:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378049.051575:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626554240:12345-0@lo:400: 00000100:00100000:2.0:1787378049.051624:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626554240:12345-0@lo:400: Request processed in 50us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378049.051631:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378049.051651:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626553984 00000100:00100000:2.0:1787378049.051655:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626553984 00000100:00100000:2.0:1787378049.051679:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626554112 00000100:00100000:2.0:1787378049.051682:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626554112 00000100:00100000:2.0:1787378049.051697:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787378049.051702:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626553984:12345-0@lo:400: 00000100:00100000:2.0:1787378049.051759:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626553984:12345-0@lo:400: Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378049.051766:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787378049.051778:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787378049.051784:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626554112:12345-0@lo:400: 00000100:00100000:2.0:1787378049.051809:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626554112:12345-0@lo:400: Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378049.051815:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787378049.051830:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378049.051834:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787378049.051862:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a23b800 x1874201626554112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378049.051875:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626554112:0@lo:400: 00010000:00080000:2.0:1787378049.051885:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a23a300 x1874201626553984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378049.051906:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626553984:0@lo:400: 00010000:00080000:2.0:1787378049.051936:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a238e00 x1874201626554240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378049.051944:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626554240:0@lo:400: 00000100:00100000:1.0:1787378049.054095:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626553856 00000100:00100000:1.0:1787378049.054109:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626553856 00000100:00100000:1.0:1787378049.054215:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787378049.054225:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3314:x1874201626553856:12345-0@lo:400: 00000100:00100000:1.0:1787378049.054335:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3314:x1874201626553856:12345-0@lo:400: Request processed in 111us (3287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378049.054342:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787378049.054423:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626553856:0@lo:400: 00000100:00100000:0.0:1787378049.572588:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787378049.572614:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626554368:0@lo:13: 00000100:00100000:0.0:1787378049.572685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378049.572827:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626554368 00000100:00100000:0.0:1787378049.572835:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626554368 00000100:00100000:0.0:1787378049.572880:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787378049.572889:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626554368:12345-0@lo:13: 00002000:00000024:0.0:1787378049.572925:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378049.572969:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626554368:12345-0@lo:13: Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378049.572976:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787378049.579086:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae988a80 x1874201626554368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378049.579112:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626554368:0@lo:13: 00000001:00080000:3.0:1787378049.659412:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787378050.011166:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378051.042092:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378052.057965:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378053.081860:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378054.105810:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378054.169907:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626554752:0@lo:400: 00000100:00100000:2.0:1787378054.169985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378054.169990:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626554624:0@lo:400: 00000100:00100000:0.0:1787378054.170020:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378054.170053:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787378054.170059:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626554496:0@lo:400: 00000100:00100000:0.0:1787378054.170087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378054.170120:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626554496 00000100:00100000:0.0:1787378054.170127:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626554496 00000100:00100000:0.0:1787378054.170178:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787378054.170187:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3312:x1874201626554496:12345-0@lo:400: 00000100:00100000:0.0:1787378054.170250:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3312:x1874201626554496:12345-0@lo:400: Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378054.170258:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787378054.170301:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626554496:0@lo:400: 00000100:00100000:2.0:1787378054.171243:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378054.171254:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626554880:0@lo:400: 00000100:00100000:2.0:1787378054.171296:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378054.171345:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626554752 00000100:00100000:2.0:1787378054.171350:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626554752 00000100:00100000:2.0:1787378054.171394:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626554624 00000100:00100000:2.0:1787378054.171397:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626554624 00000100:00100000:2.0:1787378054.171411:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787378054.171417:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626554752:12345-0@lo:400: 00000100:00100000:2.0:1787378054.171463:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626554752:12345-0@lo:400: Request processed in 46us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378054.171470:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787378054.171482:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787378054.171488:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626554624:12345-0@lo:400: 00000100:00100000:1.0:1787378054.171583:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626554880 00000100:00100000:1.0:1787378054.171589:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626554880 00000100:00100000:1.0:1787378054.171618:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787378054.171625:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626554880:12345-0@lo:400: 00000100:00100000:1.0:1787378054.171662:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626554880:12345-0@lo:400: Request processed in 37us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378054.171668:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378054.171771:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626554624:12345-0@lo:400: Request processed in 283us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378054.171778:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787378054.171800:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378054.171804:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787378054.171831:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a23b800 x1874201626554880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378054.171842:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787378054.171855:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626554880:0@lo:400: 00010000:00080000:2.0:1787378054.171866:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a23a300 x1874201626554752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378054.171874:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626554752:0@lo:400: 00010000:00080000:1.0:1787378054.171985:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eeb9a238e00 x1874201626554624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378054.172000:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626554624:0@lo:400: 00000100:00100000:0.0:1787378054.684601:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787378054.684623:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626555008:0@lo:13: 00000100:00100000:0.0:1787378054.684682:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378054.684759:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626555008 00000100:00100000:0.0:1787378054.684767:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626555008 00000100:00100000:0.0:1787378054.684807:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787378054.684814:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626555008:12345-0@lo:13: 00002000:00000024:0.0:1787378054.684843:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378054.684878:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626555008:12345-0@lo:13: Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378054.684885:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787378054.684917:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebaf44c000 x1874201626555008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378054.684934:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626555008:0@lo:13: 00000020:01000004:2.0:1787378054.901466:0:7474:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787378054.901470:0:7474:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787378054.901594:0:7474:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9eebbb181000 00000020:01000004:2.0:1787378054.901610:0:7474:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787378054.901623:0:7474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787378054.901637:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9eeb883b19c0) 00000020:00000080:2.0:1787378054.901666:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787378054.937252:0:7474:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787378054.938971:0:7474:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787378054.986304:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787378054.997705:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787378054.997768:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787378054.997826:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787378054.997851:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787378054.998171:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787378054.998184:0:7474:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787378054.998194:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdd3c5462d7852b0e 00000020:01000004:3.0:1787378054.998201:0:7474:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787378054.998223:0:7474:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787378054.998226:0:7474:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787378054.998243:0:7474:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787378054.998263:0:7474:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787378054.998267:0:7474:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787378055.038023:0:7474:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787378055.038058:0:7474:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787378055.038062:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787378055.038064:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787378055.038066:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787378055.038067:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787378055.038068:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787378055.038070:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787378055.038071:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787378055.038073:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787378055.038078:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787378055.038079:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787378055.038081:0:7474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787378055.038084:0:7474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787378055.038087:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787378055.038088:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787378055.038089:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787378055.038090:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787378055.038091:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787378055.038092:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787378055.038093:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787378055.038094:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787378055.038095:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787378055.038096:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787378055.038097:0:7474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787378055.038122:0:7474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787378055.038138:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626555136:0@lo:253: 00000100:00100000:0.0:1787378055.038208:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378055.038266:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987a59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378055.038589:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626555136 00000100:00100000:1.0:1787378055.038597:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626555136 00000100:00100000:1.0:1787378055.038644:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787378055.038652:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:7474:x1874201626555136:12345-0@lo:253: 20000000:01000000:1.0:1787378055.038680:0:5786:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787378055.038684:0:5786:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787378055.038700:0:5786:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787378055.038703:0:5786:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787378055.039928:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787378055.040114:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787378055.040126:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787378055.040160:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787378055.040166:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787378055.040188:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787378055.040225:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787378055.043401:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787378055.043435:0:5786:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:1.0:1787378055.043438:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787378055.043471:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787378055.043478:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787378055.043540:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787378055.043547:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1787378055.043577:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787378055.043586:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787378055.043617:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787378055.043704:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787378055.050460:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787378055.050586:0:5786:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:1.0:1787378055.050595:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787378055.050639:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787378055.050647:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787378055.050674:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787378055.050680:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1787378055.051010:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787378055.051022:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787378055.051078:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787378055.051116:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787378055.051133:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787378055.051136:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787378055.051142:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787378055.051144:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787378055.051146:0:5786:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787378055.051158:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787378055.051160:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787378055.051194:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787378055.051196:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787378055.056238:0:7477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787378055.056350:0:7477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787378055.056386:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787378055.057060:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787378055.057104:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787378055.057159:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787378055.057175:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787378055.057178:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787378055.066243:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787378055.066327:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787378055.066380:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787378055.066931:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787378055.066977:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787378055.067012:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787378055.067038:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787378055.067040:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787378055.069657:0:7479:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787378055.069778:0:7479:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787378055.069838:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787378055.070319:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787378055.070358:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787378055.070411:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787378055.070424:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787378055.070426:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787378055.071114:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787378055.071321:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787378055.071362:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787378055.071437:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1787378055.071456:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787378055.071474:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.071565:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.071574:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.071581:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.071588:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.071595:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.071603:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.071641:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.071661:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 16 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378055.071675:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555264:0@lo:104: 00000100:00100000:3.0:1787378055.073035:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787378055.073136:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.073148:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 16 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378055.073157:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555392:0@lo:104: 00010000:00010000:3.0:1787378055.073183:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.073190:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 16 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378055.073554:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555520:0@lo:104: 00010000:00010000:3.0:1787378055.073583:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.073591:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 16 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378055.073599:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555648:0@lo:104: 00010000:00010000:3.0:1787378055.073636:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.073653:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 16 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378055.073661:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555776:0@lo:104: 00000100:00100000:3.0:1787378055.073680:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8a342a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787378055.081344:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787378055.081395:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.081427:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.081436:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.081445:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.081457:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626555264 00000100:00100000:1.0:1787378055.081464:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626555264 00000100:00100000:1.0:1787378055.081511:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626555392 00000100:00100000:1.0:1787378055.081514:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626555392 00000100:00100000:1.0:1787378055.081525:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626555520 00000100:00100000:1.0:1787378055.081532:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626555520 00000100:00100000:1.0:1787378055.081540:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626555648 00000100:00100000:1.0:1787378055.081553:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626555648 00000100:00100000:1.0:1787378055.081567:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626555776 00000100:00100000:1.0:1787378055.081569:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626555776 00000100:00100000:1.0:1787378055.081597:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378055.081605:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb833ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+7:5786:x1874201626555264:12345-0@lo:104: 00010000:00010000:1.0:1787378055.081622:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.081789:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378055.081796:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb833ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+7:5786:x1874201626555264:12345-0@lo:104: Request processed in 191us (8765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.081803:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378055.081842:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787378055.081849:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+6:5786:x1874201626555392:12345-0@lo:104: 00010000:00010000:1.0:1787378055.081857:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.081890:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787378055.081895:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+6:5786:x1874201626555392:12345-0@lo:104: Request processed in 47us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.081901:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787378055.081912:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787378055.081918:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:5786:x1874201626555520:12345-0@lo:104: 00010000:00010000:1.0:1787378055.081925:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.081953:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787378055.081958:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:5786:x1874201626555520:12345-0@lo:104: Request processed in 41us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.081973:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787378055.081985:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787378055.081990:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:5786:x1874201626555648:12345-0@lo:104: 00010000:00010000:1.0:1787378055.081997:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082022:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787378055.082027:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:5786:x1874201626555648:12345-0@lo:104: Request processed in 38us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.082032:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787378055.082042:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787378055.082047:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5786:x1874201626555776:12345-0@lo:104: 00010000:00010000:1.0:1787378055.082053:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082081:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787378055.082086:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5786:x1874201626555776:12345-0@lo:104: Request processed in 39us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.082091:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787378055.082119:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787378055.082124:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082130:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547200 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378055.082135:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082153:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378055.082161:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378055.082166:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378055.082204:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082210:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378055.082244:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082251:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81547200/0xdd3c5462d7852af9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b00 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082262:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787378055.082265:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082271:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7c00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378055.082273:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082280:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378055.082285:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378055.082297:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378055.082311:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082316:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378055.082329:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082336:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7c00/0xdd3c5462d7852acf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ad6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082346:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787378055.082348:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082353:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b200 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378055.082356:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082362:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378055.082367:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378055.082372:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378055.082382:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082388:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378055.082400:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082406:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128b200/0xdd3c5462d7852ab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852aba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082415:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787378055.082418:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082423:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6200 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378055.082425:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082432:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378055.082438:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378055.082443:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378055.082456:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082461:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378055.082466:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082471:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6200/0xdd3c5462d7852a89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a90 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082481:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378055.082489:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082494:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378055.082498:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082505:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378055.082511:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378055.082516:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378055.082528:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082533:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378055.082536:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082542:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81546000/0xdd3c5462d7852a5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a66 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.082555:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378055.082556:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378055.082558:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378055.082566:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378055.082571:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378055.082595:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626556288:0@lo:103: 00000100:00100000:1.0:1787378055.082630:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.082672:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787378055.082679:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626555904:0@lo:103: 00000100:00100000:1.0:1787378055.082700:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.082714:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626556416:0@lo:103: 00000100:00100000:1.0:1787378055.082778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.082806:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626556032:0@lo:103: 00000100:00100000:1.0:1787378055.082827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.082843:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787378055.082847:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626556160:0@lo:103: 00000100:00100000:1.0:1787378055.082865:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.082888:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626556288 00000100:00100000:1.0:1787378055.082893:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626556288 00010000:00010000:1.0:1787378055.082927:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 17 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.082942:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626555904 00000100:00100000:1.0:1787378055.082945:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626555904 00010000:00010000:1.0:1787378055.082954:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 18 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.082962:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626556416 00000100:00100000:1.0:1787378055.082964:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626556416 00010000:00010000:1.0:1787378055.082972:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 19 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.082980:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626556032 00000100:00100000:1.0:1787378055.082983:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626556032 00010000:00010000:1.0:1787378055.082989:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 20 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.082998:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626556160 00000100:00100000:1.0:1787378055.083004:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626556160 00010000:00010000:1.0:1787378055.083015:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 21 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.083027:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378055.083032:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+21:3311:x1874201626556288:12345-0@lo:103: 00010000:00010000:1.0:1787378055.083042:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378055.083046:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 21 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.083055:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 21 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.083069:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378055.083095:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+21:3311:x1874201626556288:12345-0@lo:103: Request processed in 63us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.083102:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378055.083113:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787378055.083118:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3311:x1874201626555904:12345-0@lo:103: 00010000:00010000:1.0:1787378055.083125:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378055.083129:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 20 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.083138:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 20 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.083146:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378055.083163:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3311:x1874201626555904:12345-0@lo:103: Request processed in 45us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.083169:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787378055.083187:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787378055.083192:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626556416:12345-0@lo:103: 00010000:00010000:1.0:1787378055.083199:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378055.083203:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 19 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.083211:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 19 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.083220:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378055.083811:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787378055.083822:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626556032:12345-0@lo:103: 00010000:00010000:2.0:1787378055.083832:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378055.083837:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 19 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.083846:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 19 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.083871:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378055.083909:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626556032:12345-0@lo:103: Request processed in 90us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378055.083917:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787378055.083931:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787378055.083937:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:3313:x1874201626556160:12345-0@lo:103: 00010000:00010000:2.0:1787378055.083945:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378055.083949:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 18 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.083956:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 18 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.083967:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.083974:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.083987:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.083994:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.084000:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.084006:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.084018:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378055.084022:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.084030:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.084038:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.084048:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378055.084070:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:3313:x1874201626556160:12345-0@lo:103: Request processed in 134us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378055.084076:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787378055.084865:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626555904:0@lo:103: 00000100:00100000:0.0:1787378055.084879:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626556288:0@lo:103: 00000100:00100000:0.0:1787378055.084914:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626556160:0@lo:103: 00000100:00100000:0.0:1787378055.084922:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626556032:0@lo:103: 00000100:00100000:1.0:1787378055.085215:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:3311:x1874201626556416:12345-0@lo:103: Request processed in 2020us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.085224:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787378055.090879:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626556416:0@lo:103: 00010000:00010000:3.0:1787378055.091950:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128be00/0xdd3c5462d7852b00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852af9 expref: 16 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378055.091968:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555264:0@lo:104: 00010000:00010000:1.0:1787378055.092214:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852ad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852acf expref: 15 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.092235:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555392:0@lo:104: 00010000:00010000:1.0:1787378055.092249:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852aba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852ab3 expref: 14 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.092259:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555520:0@lo:104: 00010000:00010000:1.0:1787378055.092270:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81484000/0xdd3c5462d7852a90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852a89 expref: 13 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.092278:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555648:0@lo:104: 00010000:00010000:1.0:1787378055.092287:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81484200/0xdd3c5462d7852a66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852a5f expref: 12 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378055.092294:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5786:1874201626555776:0@lo:104: 00010000:00010000:1.0:1787378055.092344:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.092353:0:5786:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.092359:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.092365:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81547e00/0xdd3c5462d7852b15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787378055.092379:0:5786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1787378055.131116:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378055.178191:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:7474:x1874201626555136:12345-0@lo:253: Request processed in 139529us (139972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.178206:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787378055.178286:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626555136:0@lo:253: 10000000:01000000:0.0:1787378055.178302:0:7474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787378055.178305:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787378055.178307:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787378055.178308:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787378055.178309:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787378055.178311:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787378055.178312:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787378055.178313:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787378055.178315:0:7474:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787378055.178317:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787378055.178318:0:7474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787378055.178339:0:7474:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eebbb181000 from lustre-OST0001 10000000:01000000:0.0:1787378055.178366:0:7474:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787378055.178369:0:7474:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787378055.178376:0:7474:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eeb882799c0 local copy 10000000:01000000:0.0:1787378055.178380:0:7474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787378055.178413:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.178426:0:7474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.178436:0:7474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378055.178452:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626556544:0@lo:101: 00000100:00100000:0.0:1787378055.178482:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378055.178537:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987a5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787378055.178603:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626556544 00000100:00100000:3.0:1787378055.178610:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626556544 00000100:00100000:3.0:1787378055.178649:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787378055.178657:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+11:7474:x1874201626556544:12345-0@lo:101: 00010000:00010000:3.0:1787378055.178669:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378055.178683:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852b23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852b1c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.178707:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852b1c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.178742:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b1c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.178752:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546200, rc 0) 00000100:00100000:3.0:1787378055.178929:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626556544:12345-0@lo:101: Request processed in 272us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.178936:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787378055.179280:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626556544:0@lo:101: 00010000:00010000:2.0:1787378055.179293:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.179301:0:7474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378055.179409:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626556672:0@lo:501: 00000100:00100000:2.0:1787378055.179437:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378055.179472:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787378055.179836:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626556672 00000100:00100000:3.0:1787378055.179841:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626556672 00000100:00100000:3.0:1787378055.179875:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787378055.179882:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626556672:12345-0@lo:501: 00000100:00100000:3.0:1787378055.180118:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626556672:12345-0@lo:501: Request processed in 235us (678us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787378055.180125:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787378055.181740:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626556672:0@lo:501: 10000000:01000000:3.0:1787378055.181891:0:7474:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787378055.181941:0:7474:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787378055.181949:0:7474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.181958:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.181965:0:7474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.181989:0:7474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787378055.182014:0:7474:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eebbb181000 10000000:01000000:3.0:1787378055.182019:0:7474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787378055.182025:0:7474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787378055.182028:0:7474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787378055.182031:0:7474:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787378055.182034:0:7474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787378055.182063:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.182084:0:7474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.182094:0:7474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378055.182112:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626556800:0@lo:101: 00000100:00100000:3.0:1787378055.182159:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378055.182200:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8a342480 going to sleep for 11 seconds 00010000:00010000:1.0:1787378055.182277:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378055.182283:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.182290:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378055.182293:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.182300:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378055.182307:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378055.182312:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378055.182330:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.182347:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378055.182378:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.182385:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd3c5462d7852b23 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.182397:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378055.182399:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378055.182400:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378055.182441:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787378055.182454:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626556928:0@lo:103: 00000100:00100000:3.0:1787378055.182493:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378055.182607:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626556928 00000100:00100000:0.0:1787378055.182614:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626556928 00000100:00100000:2.0:1787378055.182620:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626556800 00000100:00100000:2.0:1787378055.182623:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626556800 00000100:00100000:2.0:1787378055.182662:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787378055.182662:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378055.182670:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626556800:12345-0@lo:101: 00000100:00100000:0.0:1787378055.182674:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3314:x1874201626556928:12345-0@lo:103: 00010000:00010000:2.0:1787378055.182681:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378055.182684:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378055.182691:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852b2a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.182696:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852b23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852b1c expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.182708:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.187023:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378055.187125:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3314:x1874201626556928:12345-0@lo:103: Request processed in 4445us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378055.187138:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787378055.188047:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626556928:0@lo:103: 00010000:00010000:2.0:1787378055.189644:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.189661:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6200, rc 0) 00000100:00100000:3.0:1787378055.189989:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626556800:12345-0@lo:101: Request processed in 7317us (7828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.189999:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787378055.190140:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626556800:0@lo:101: 00010000:00010000:0.0:1787378055.190161:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.190172:0:7474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378055.190305:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557056:0@lo:501: 00000100:00100000:0.0:1787378055.190340:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378055.190380:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987a50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378055.190428:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626557056 00000100:00100000:3.0:1787378055.190435:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626557056 00000100:00100000:3.0:1787378055.190507:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787378055.190516:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557056:12345-0@lo:501: 00000100:00100000:3.0:1787378055.190792:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557056:12345-0@lo:501: Request processed in 276us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.190807:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787378055.190883:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557056:0@lo:501: 00000100:00100000:1.0:1787378055.190914:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557184:0@lo:503: 00000100:00100000:1.0:1787378055.190952:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.195978:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbfaf7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787378055.197496:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626557184 00000100:00100000:0.0:1787378055.197509:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626557184 00000100:00100000:0.0:1787378055.197570:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787378055.197579:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557184:12345-0@lo:503: 00000100:00100000:1.0:1787378055.202140:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557184:12345-0@lo:503: Request processed in 4552us (11176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.202154:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787378055.202293:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557184:0@lo:503: 00000040:00080000:0.0:1787378055.202621:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787378055.202715:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557312:0@lo:502: 00000100:00100000:0.0:1787378055.203158:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378055.203202:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987a56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378055.203259:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626557312 00000100:00100000:3.0:1787378055.203266:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626557312 00000100:00100000:3.0:1787378055.203300:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787378055.203309:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557312:12345-0@lo:502: 00000100:00100000:3.0:1787378055.203512:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557312:12345-0@lo:502: Request processed in 203us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.203520:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787378055.203602:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557312:0@lo:502: 00000040:00080000:0.0:1787378055.203921:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787378055.203975:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787378055.204009:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787378055.204057:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787378055.204106:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787378055.204140:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787378055.204170:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557440:0@lo:502: 00000100:00100000:0.0:1787378055.204209:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378055.204253:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987a56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378055.204478:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626557440 00000100:00100000:3.0:1787378055.204484:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626557440 00000100:00100000:3.0:1787378055.204522:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787378055.204529:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557440:12345-0@lo:502: 00000100:00100000:3.0:1787378055.204669:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557440:12345-0@lo:502: Request processed in 139us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.204676:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787378055.204968:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557440:0@lo:502: 00000040:00080000:0.0:1787378055.205055:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787378055.205065:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787378055.206058:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787378055.206068:0:7482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787378055.206075:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378055.206077:0:7482:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787378055.206082:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787378055.206111:0:7482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9eebb5384d40) 00000020:00000080:0.0:1787378055.206132:0:7482:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787378055.206138:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787378055.206195:0:7482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eebbb181000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787378055.206202:0:7482:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787378055.206208:0:7482:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdd3c5462d7852b3f 00010000:00010000:1.0:1787378055.218192:0:7482:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787378055.218523:0:7482:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787378055.225069:0:7482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787378055.225378:0:7482:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787378055.231681:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787378055.233510:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787378055.238413:0:7482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787378055.238427:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378055.238433:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378055.238435:0:7482:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787378055.238439:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378055.238442:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378055.238443:0:7482:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787378055.238446:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787378055.238448:0:7482:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787378055.238913:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378055.238919:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378055.238920:0:7482:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787378055.238924:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787378055.250406:0:7474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787378055.250448:0:7474:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787378055.250470:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.250510:0:7474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378055.250518:0:7474:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebbb181000 from 1 10000000:01000000:0.0:1787378055.250521:0:7474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787378055.250556:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.250572:0:7474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.250583:0:7474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378055.250604:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557568:0@lo:101: 00000100:00100000:0.0:1787378055.250667:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378055.250703:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787378055.252965:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626557568 00000100:00100000:3.0:1787378055.252980:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626557568 00000100:00100000:3.0:1787378055.253045:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787378055.253055:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:7474:x1874201626557568:12345-0@lo:101: 00010000:00010000:3.0:1787378055.253071:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378055.253089:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852b46 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.253115:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.253126:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.253135:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546800, rc 0) 00000100:00100000:3.0:1787378055.253205:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626557568:12345-0@lo:101: Request processed in 151us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.253212:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787378055.253459:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557568:0@lo:101: 00010000:00010000:2.0:1787378055.253476:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.253495:0:7474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378055.253615:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557696:0@lo:501: 00000100:00100000:2.0:1787378055.253645:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378055.253671:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787378055.253836:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626557696 00000100:00100000:0.0:1787378055.253842:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626557696 00000100:00100000:0.0:1787378055.253871:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787378055.253878:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626557696:12345-0@lo:501: 00000100:00100000:0.0:1787378055.254088:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626557696:12345-0@lo:501: Request processed in 209us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378055.254095:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787378055.254247:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557696:0@lo:501: 00000100:00100000:2.0:1787378055.254275:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557824:0@lo:503: 00000100:00100000:2.0:1787378055.254311:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378055.254328:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787378055.254935:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626557824 00000100:00100000:3.0:1787378055.254941:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626557824 00000100:00100000:3.0:1787378055.254975:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787378055.254982:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626557824:12345-0@lo:503: 00000100:00100000:3.0:1787378055.255309:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626557824:12345-0@lo:503: Request processed in 326us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.255316:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787378055.255713:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557824:0@lo:503: 00000040:00080000:2.0:1787378055.256061:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787378055.256140:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557952:0@lo:502: 00000100:00100000:2.0:1787378055.256187:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378055.256219:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787378055.256566:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626557952 00000100:00100000:3.0:1787378055.256571:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626557952 00000100:00100000:3.0:1787378055.256611:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787378055.256619:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626557952:12345-0@lo:502: 00000100:00100000:3.0:1787378055.270342:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626557952:12345-0@lo:502: Request processed in 13713us (14144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.270357:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787378055.270364:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626557952:0@lo:502: 00000040:00080000:2.0:1787378055.270694:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787378055.271148:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787378055.271189:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558080:0@lo:502: 00000100:00100000:2.0:1787378055.271253:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378055.271289:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787378055.273580:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626558080 00000100:00100000:0.0:1787378055.273594:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626558080 00000100:00100000:0.0:1787378055.273664:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787378055.273674:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626558080:12345-0@lo:502: 00000100:00100000:0.0:1787378055.274002:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626558080:12345-0@lo:502: Request processed in 328us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378055.274010:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787378055.274433:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558080:0@lo:502: 00000040:00080000:2.0:1787378055.274638:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787378055.274655:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787378055.281437:0:7486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378055.281452:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378055.281454:0:7486:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787378055.281462:0:7486:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eebbb181000 00000020:00000080:0.0:1787378055.281464:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787378055.282376:0:7486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378055.282386:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378055.282388:0:7486:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787378055.282392:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787378055.282690:0:7474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787378055.282716:0:7474:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787378055.283015:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.283041:0:7474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378055.283091:0:7474:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787378055.283095:0:7474:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eebbb181000 10000000:01000000:2.0:1787378055.283097:0:7474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eebbb181000 10000000:01000000:2.0:1787378055.283101:0:7474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787378055.283107:0:7474:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eebbb181000 from 1 10000000:01000000:2.0:1787378055.283110:0:7474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787378055.283146:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.283154:0:7474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.283165:0:7474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378055.283187:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558208:0@lo:101: 00000100:00100000:2.0:1787378055.284459:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378055.284641:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626558208 00000100:00100000:3.0:1787378055.284651:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626558208 00000100:00100000:3.0:1787378055.284701:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787378055.284708:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626558208:12345-0@lo:101: 00000100:00100000:2.0:1787378055.285013:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939bf00 going to sleep for 11 seconds 00010000:00010000:3.0:1787378055.285268:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378055.285355:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852b54 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.285389:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.285402:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378055.285411:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546000, rc 0) 00000100:00100000:3.0:1787378055.285644:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558208:12345-0@lo:101: Request processed in 934us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.285652:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787378055.285984:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558208:0@lo:101: 00010000:00010000:2.0:1787378055.286002:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.286012:0:7474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378055.286134:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558336:0@lo:501: 00000100:00100000:2.0:1787378055.286405:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378055.286469:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787378055.286629:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626558336 00000100:00100000:0.0:1787378055.286635:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626558336 00000100:00100000:0.0:1787378055.286708:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787378055.286742:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558336:12345-0@lo:501: 00000100:00100000:0.0:1787378055.287014:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558336:12345-0@lo:501: Request processed in 297us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378055.287021:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787378055.287239:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558336:0@lo:501: 00000100:00100000:3.0:1787378055.287677:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558464:0@lo:503: 00000100:00100000:3.0:1787378055.287743:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378055.287776:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb881389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378055.288603:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626558464 00000100:00100000:2.0:1787378055.288610:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626558464 00000100:00100000:2.0:1787378055.288647:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787378055.288655:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558464:12345-0@lo:503: 00000100:00100000:2.0:1787378055.289250:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558464:12345-0@lo:503: Request processed in 593us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378055.289259:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787378055.289477:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558464:0@lo:503: 00000040:00080000:3.0:1787378055.290092:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787378055.290238:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558592:0@lo:502: 00000100:00100000:3.0:1787378055.290367:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378055.290409:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb881389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378055.290934:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626558592 00000100:00100000:1.0:1787378055.290942:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626558592 00000100:00100000:1.0:1787378055.290988:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787378055.290996:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558592:12345-0@lo:502: 00000100:00100000:1.0:1787378055.291247:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558592:12345-0@lo:502: Request processed in 250us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.291255:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787378055.291307:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558592:0@lo:502: 00000040:00080000:1.0:1787378055.291568:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787378055.291622:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787378055.291661:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787378055.291708:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787378055.291852:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787378055.291906:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787378055.291944:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787378055.291979:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787378055.292029:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787378055.292064:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787378055.292101:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787378055.292148:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787378055.292187:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787378055.292251:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787378055.292306:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787378055.292343:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787378055.292381:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787378055.292431:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787378055.292469:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787378055.292506:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787378055.292572:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787378055.292609:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787378055.292643:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787378055.292694:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787378055.292759:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787378055.295084:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787378055.295168:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787378055.295237:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787378055.295276:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787378055.295326:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787378055.295363:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787378055.295398:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787378055.295434:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787378055.295482:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787378055.295515:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787378055.295577:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787378055.295627:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787378055.295673:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558720:0@lo:502: 00000100:00100000:1.0:1787378055.296292:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.296343:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378055.296768:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626558720 00000100:00100000:2.0:1787378055.296777:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626558720 00000100:00100000:2.0:1787378055.296844:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787378055.296853:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558720:12345-0@lo:502: 00000100:00100000:2.0:1787378055.297110:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626558720:12345-0@lo:502: Request processed in 256us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378055.297118:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787378055.297287:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626558720:0@lo:502: 00000040:00080000:3.0:1787378055.297383:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787378055.297397:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787378055.299446:0:7487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787378055.299465:0:7487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9eeb91793380) 00000020:00000080:3.0:1787378055.299487:0:7487:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787378055.299662:0:7487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eebbb181000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787378055.299666:0:7487:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eebbb181000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787378055.299669:0:7487:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eebbb181000 3 00010000:00080000:3.0:1787378055.299697:0:7487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eea821c2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1787378055.306164:0:7487:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787378055.306276:0:7487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787378055.306315:0:7487:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787378055.306327:0:7487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdd3c5462d7852b69 00000100:00080000:3.0:1787378055.306337:0:7487:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787378055.306351:0:7487:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eea821c2800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787378055.306388:0:7487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebade80000 x1874201626558848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787378055.306414:0:7487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787378055.306501:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626558976:0@lo:400: 00000100:00100000:3.0:1787378055.306569:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378055.306615:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626559104:0@lo:400: 00000100:00100000:3.0:1787378055.306638:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378055.306654:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787378055.306659:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626559232:0@lo:400: 00000100:00100000:3.0:1787378055.306681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378055.306687:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874201626558848:0@lo:38: 00000100:00100000:3.0:1787378055.306711:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626558976 00000100:00100000:0.0:1787378055.306716:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378055.306738:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626558976 00000100:00100000:2.0:1787378055.307179:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626559104 00000100:00100000:2.0:1787378055.307185:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626559104 00000100:00100000:2.0:1787378055.307205:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626558848 00000100:00100000:2.0:1787378055.307209:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626558848 00000100:00100000:2.0:1787378055.307221:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787378055.307240:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626558976:12345-0@lo:400: 00000100:00100000:2.0:1787378055.307309:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626558976:12345-0@lo:400: Request processed in 70us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378055.307316:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787378055.307339:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787378055.307347:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626559104:12345-0@lo:400: 00000100:00100000:2.0:1787378055.307386:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626559104:12345-0@lo:400: Request processed in 39us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378055.307392:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787378055.307404:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378055.307409:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874201626558848:12345-0@lo:38: 00010000:00080000:2.0:1787378055.307427:0:5791:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1787378055.307456:0:5791:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdd3c5462d7852b70 00000004:00100000:2.0:1787378055.307469:0:5791:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787378055.307495:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9eeb87698800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378055.307532:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874201626558848:12345-0@lo:38: Request processed in 122us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378055.307538:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787378055.307573:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebade80000 x1874201626558848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787378065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378055.307583:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787378055.307591:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787378055.307598:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787378055.307602:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787378055.307605:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eea821c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787378055.307610:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874201626558848:0@lo:38: 00010000:00080000:1.0:1787378055.307994:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebade80700 x1874201626559104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378055.308005:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626559104:0@lo:400: 00010000:00080000:0.0:1787378055.308134:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebade82d80 x1874201626558976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378055.308144:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626558976:0@lo:400: 00000100:00100000:0.0:1787378055.309000:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626559232 00000100:00100000:0.0:1787378055.309009:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626559232 00000100:00100000:0.0:1787378055.309053:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787378055.309061:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626559232:12345-0@lo:400: 00000100:00100000:0.0:1787378055.309135:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626559232:12345-0@lo:400: Request processed in 75us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378055.309142:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787378055.309413:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebade81880 x1874201626559232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378055.309426:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626559232:0@lo:400: 00000100:00100000:1.0:1787378055.310123:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7489:1874201626559360:0@lo:901: 00000100:00100000:1.0:1787378055.310167:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787378055.310306:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787378055.311241:0:7474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787378055.311270:0:7474:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787378055.311295:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.311308:0:7474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787378055.311364:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787378055.311366:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787378055.311368:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378055.311369:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378055.311370:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378055.311372:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378055.311373:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378055.311374:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787378055.311376:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787378055.311377:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378055.311378:0:7474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787378055.311382:0:7474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787378055.311385:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787378055.311386:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787378055.311387:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378055.311388:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378055.311389:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378055.311391:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378055.311391:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378055.311392:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787378055.311393:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787378055.311394:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378055.311395:0:7474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787378055.311424:0:7474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787378055.311438:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626559488:0@lo:253: 00000100:00100000:1.0:1787378055.311481:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378055.311507:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8982cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378055.311521:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8982c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378055.311848:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626559488 00000100:00100000:0.0:1787378055.311855:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626559488 00000100:00100000:0.0:1787378055.311900:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787378055.311910:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7474:x1874201626559488:12345-0@lo:253: 20000000:01000000:0.0:1787378055.311938:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787378055.311951:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787378055.315376:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626559360 00000100:00100000:3.0:1787378055.315390:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626559360 00000100:00100000:3.0:1787378055.315448:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787378055.315459:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7489:x1874201626559360:12345-0@lo:901: 00000100:00100000:3.0:1787378055.316081:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7489:x1874201626559360:12345-0@lo:901: Request processed in 622us (5911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378055.316089:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787378055.316114:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787378055.322130:0:7489:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae988380 x1874201626559360/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787378071 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378055.322149:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7489:1874201626559360:0@lo:901: 20000000:01000000:0.0:1787378055.355932:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787378055.355955:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787378055.356011:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787378055.356016:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787378055.356036:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.356074:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.356082:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.356119:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.356132:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 14 pid: 5786 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378055.356147:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874201626559616:0@lo:104: 00000100:00100000:2.0:1787378055.356208:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378055.356262:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787378055.356339:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626559616 00000100:00100000:0.0:1787378055.356347:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626559616 00000100:00100000:0.0:1787378055.356394:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787378055.356403:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5806:x1874201626559616:12345-0@lo:104: 00010000:00010000:0.0:1787378055.356415:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378055.356462:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787378055.356467:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:5806:x1874201626559616:12345-0@lo:104: Request processed in 66us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378055.356474:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787378055.356550:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378055.356556:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.356569:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a200 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378055.356573:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.356581:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378055.356588:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378055.356594:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378055.356631:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.356637:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378055.356656:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.356662:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852ac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ac8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378055.356677:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378055.356678:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378055.356680:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378055.356688:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378055.356698:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626559744:0@lo:103: 00000100:00100000:1.0:1787378055.356903:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378055.357249:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626559744 00000100:00100000:2.0:1787378055.357254:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626559744 00010000:00010000:2.0:1787378055.357276:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 15 pid: 5786 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378055.357304:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378055.357311:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:3314:x1874201626559744:12345-0@lo:103: 00010000:00010000:2.0:1787378055.357322:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378055.357327:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 15 pid: 5786 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357338:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 15 pid: 5786 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357369:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357376:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787378055.357388:0:6603:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001661258s 00010000:00010000:2.0:1787378055.357392:0:6603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357399:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357405:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357411:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357416:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378055.357420:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357428:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357436:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357445:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378055.357490:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:3314:x1874201626559744:12345-0@lo:103: Request processed in 179us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378055.357503:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787378055.357563:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81547400/0xdd3c5462d7852ac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852ac1 expref: 14 pid: 5786 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378055.357575:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874201626559616:0@lo:104: 00010000:00010000:2.0:1787378055.357593:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357601:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357607:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378055.357613:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6600/0xdd3c5462d7852b77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378055.357679:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626559744:0@lo:103: 00000100:00100000:1.0:1787378055.372066:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:7474:x1874201626559488:12345-0@lo:253: Request processed in 60146us (60574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378055.372097:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787378055.372292:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7474:1874201626559488:0@lo:253: 10000000:01000000:3.0:1787378055.372308:0:7474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787378055.372312:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787378055.372313:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787378055.372315:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378055.372316:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378055.372317:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378055.372324:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378055.372326:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787378055.372327:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787378055.372329:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787378055.372330:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378055.372331:0:7474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787378055.372346:0:7474:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787378055.378468:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787378055.378873:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787378055.379090:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787378055.379294:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787378055.379472:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787378055.379986:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787378055.381312:0:7474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787378055.595479:0:7474:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787378055.595487:0:7474:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787378055.595523:0:7474:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787378055.595580:0:7474:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787378055.595598:0:7474:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787378055.595635:0:7474:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787378056.153870:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378057.178361:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378058.207298:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378059.225872:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378059.808109:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626559872:0@lo:13: 00000100:00100000:0.0:1787378059.808180:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378059.808340:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626559872 00000100:00100000:1.0:1787378059.808348:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626559872 00000100:00100000:1.0:1787378059.808417:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787378059.808427:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626559872:12345-0@lo:13: 00002000:00000024:1.0:1787378059.808460:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378059.808508:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626559872:12345-0@lo:13: Request processed in 82us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378059.808515:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787378059.808636:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787378059.808700:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae988000 x1874201626559872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378059.808967:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626559872:0@lo:13: 00010000:00010000:1.0:1787378060.249823:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378060.314043:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626560128:0@lo:400: 00000100:00100000:2.0:1787378060.314106:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378060.314166:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787378060.314172:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626560000:0@lo:400: 00000100:00100000:2.0:1787378060.314213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378060.314245:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626560256:0@lo:400: 00000100:00100000:2.0:1787378060.314267:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378060.314286:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378060.314291:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626560384:0@lo:400: 00000100:00100000:2.0:1787378060.314310:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378060.314342:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626560128 00000100:00100000:2.0:1787378060.314349:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626560128 00000100:00100000:2.0:1787378060.314383:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626560256 00000100:00100000:2.0:1787378060.314386:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626560256 00000100:00100000:2.0:1787378060.314406:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626560384 00000100:00100000:2.0:1787378060.314409:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626560384 00000100:00100000:2.0:1787378060.314424:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787378060.314432:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626560128:12345-0@lo:400: 00000100:00100000:2.0:1787378060.314481:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626560128:12345-0@lo:400: Request processed in 48us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378060.314487:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787378060.314502:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378060.314507:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626560256:12345-0@lo:400: 00000100:00100000:2.0:1787378060.314533:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626560256:12345-0@lo:400: Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378060.314549:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378060.314563:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787378060.314568:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626560384:12345-0@lo:400: 00000100:00100000:2.0:1787378060.314591:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626560384:12345-0@lo:400: Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378060.314607:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787378060.314625:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626560000 00000100:00100000:2.0:1787378060.314628:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626560000 00000100:00100000:2.0:1787378060.314647:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787378060.314652:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3312:x1874201626560000:12345-0@lo:400: 00000100:00100000:2.0:1787378060.314679:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3312:x1874201626560000:12345-0@lo:400: Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378060.314685:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787378060.314715:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787378060.314762:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eeb9a23a300 x1874201626560384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378060.314775:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626560384:0@lo:400: 00010000:00080000:2.0:1787378060.314786:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eeb9a23b800 x1874201626560256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378060.314793:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626560256:0@lo:400: 00000100:00100000:2.0:1787378060.314819:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626560000:0@lo:400: 00010000:00080000:2.0:1787378060.314827:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eeb9a238a80 x1874201626560128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378060.314834:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626560128:0@lo:400: 00010000:00010000:2.0:1787378061.275372:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787378061.692006:0:7829:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787378062.298194:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378063.338237:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378064.346709:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787378064.412359:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787378064.412366:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eeb88344000 from 30 10000000:01000000:0.0:1787378064.412371:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787378064.412414:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.412426:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.412437:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378064.412460:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626560512:0@lo:101: 00000100:00100000:0.0:1787378064.412528:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378064.412581:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.412648:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626560512 00000100:00100000:3.0:1787378064.412655:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626560512 00000100:00100000:3.0:1787378064.412705:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787378064.412713:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626560512:12345-0@lo:101: 00010000:00010000:3.0:1787378064.412746:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378064.412759:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852b7e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.412780:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.412791:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.412800:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547c00, rc 0) 00000100:00100000:3.0:1787378064.412840:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626560512:12345-0@lo:101: Request processed in 127us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.412847:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787378064.412891:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626560512:0@lo:101: 00010000:00010000:3.0:1787378064.412905:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.412932:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378064.412992:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626560640:0@lo:501: 00000100:00100000:3.0:1787378064.413016:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.413036:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84565300 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.413048:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626560640 00000100:00100000:3.0:1787378064.413051:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626560640 00000100:00100000:3.0:1787378064.413071:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787378064.413077:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626560640:12345-0@lo:501: 00000100:00100000:2.0:1787378064.413484:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626560640:12345-0@lo:501: Request processed in 404us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.413494:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787378064.413797:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626560640:0@lo:501: 00000100:00100000:3.0:1787378064.413829:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626560768:0@lo:503: 00000100:00100000:3.0:1787378064.413866:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.413895:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84565300 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.413920:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626560768 00000100:00100000:2.0:1787378064.413926:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626560768 00000100:00100000:2.0:1787378064.413954:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787378064.413963:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626560768:12345-0@lo:503: 00000100:00100000:2.0:1787378064.414290:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626560768:12345-0@lo:503: Request processed in 327us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.414297:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787378064.414431:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626560768:0@lo:503: 00000100:00100000:1.0:1787378064.420162:0:7937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7937:1874201626560896:0@lo:502: 00000100:00100000:1.0:1787378064.420262:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.420310:0:7937:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787378064.420359:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626560896 00000100:00100000:0.0:1787378064.420367:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626560896 00000100:00100000:0.0:1787378064.420416:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787378064.420425:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7937:x1874201626560896:12345-0@lo:502: 00000100:00100000:0.0:1787378064.420781:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7937:x1874201626560896:12345-0@lo:502: Request processed in 355us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378064.420789:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787378064.422538:0:7937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7937:1874201626560896:0@lo:502: 00000100:00100000:1.0:1787378064.422610:0:7937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7937:1874201626561024:0@lo:502: 00000100:00100000:1.0:1787378064.422672:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.422717:0:7937:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.422769:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626561024 00000100:00100000:2.0:1787378064.422777:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626561024 00000100:00100000:2.0:1787378064.422828:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787378064.423119:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7937:x1874201626561024:12345-0@lo:502: 00000100:00100000:2.0:1787378064.423379:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:7937:x1874201626561024:12345-0@lo:502: Request processed in 543us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.423387:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787378064.427524:0:7937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7937:1874201626561024:0@lo:502: 00000040:00080000:1.0:1787378064.427570:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787378064.428393:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787378064.428420:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787378064.428434:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378064.428658:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378064.428675:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787378064.428677:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787378064.428695:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787378064.428751:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378064.428759:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378064.428769:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378064.428796:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561152:0@lo:101: 00000100:00100000:2.0:1787378064.429593:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378064.429645:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb855e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.429792:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626561152 00000100:00100000:3.0:1787378064.429800:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626561152 00000100:00100000:3.0:1787378064.429861:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787378064.429870:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626561152:12345-0@lo:101: 00010000:00010000:3.0:1787378064.429884:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378064.429899:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852b8c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.429922:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.429933:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.429951:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547200, rc 0) 00000100:00100000:3.0:1787378064.429993:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626561152:12345-0@lo:101: Request processed in 124us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.430000:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787378064.430177:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561152:0@lo:101: 00010000:00010000:2.0:1787378064.430191:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378064.430200:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378064.430256:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561280:0@lo:501: 00000100:00100000:2.0:1787378064.430284:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378064.430316:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb855e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.430330:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626561280 00000100:00100000:2.0:1787378064.430334:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626561280 00000100:00100000:2.0:1787378064.430354:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787378064.430360:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626561280:12345-0@lo:501: 00000100:00100000:2.0:1787378064.430780:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626561280:12345-0@lo:501: Request processed in 418us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.430797:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787378064.430833:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561280:0@lo:501: 00000100:00100000:2.0:1787378064.430861:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561408:0@lo:503: 00000100:00100000:2.0:1787378064.430900:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378064.430922:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb855e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.430934:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626561408 00000100:00100000:2.0:1787378064.430937:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626561408 00000100:00100000:2.0:1787378064.430958:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787378064.430965:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626561408:12345-0@lo:503: 00000100:00100000:2.0:1787378064.431991:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626561408:12345-0@lo:503: Request processed in 1023us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.432001:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787378064.433294:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561408:0@lo:503: 00000100:00100000:1.0:1787378064.436528:0:7939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7939:1874201626561536:0@lo:502: 00000100:00100000:1.0:1787378064.436627:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.436667:0:7939:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683480 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.437473:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626561536 00000100:00100000:2.0:1787378064.437481:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626561536 00000100:00100000:2.0:1787378064.437593:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787378064.437603:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:7939:x1874201626561536:12345-0@lo:502: 00000100:00100000:2.0:1787378064.438181:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:7939:x1874201626561536:12345-0@lo:502: Request processed in 578us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.438189:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787378064.438512:0:7939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7939:1874201626561536:0@lo:502: 00000020:01000000:1.0:1787378064.438549:0:7939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378064.438558:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378064.438561:0:7939:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787378064.438566:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787378064.438568:0:7939:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787378064.438593:0:7939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7939:1874201626561664:0@lo:502: 00000100:00100000:1.0:1787378064.438639:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.438675:0:7939:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683480 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.438740:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626561664 00000100:00100000:3.0:1787378064.438745:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626561664 00000100:00100000:3.0:1787378064.438780:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787378064.438788:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:7939:x1874201626561664:12345-0@lo:502: 00000100:00100000:3.0:1787378064.438946:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:7939:x1874201626561664:12345-0@lo:502: Request processed in 158us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.438954:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787378064.438965:0:7939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7939:1874201626561664:0@lo:502: 00000020:01000000:0.0:1787378064.438983:0:7939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378064.438993:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378064.438995:0:7939:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787378064.438999:0:7939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787378064.439067:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787378064.439088:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787378064.439097:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.439107:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378064.439117:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787378064.439120:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eeb8a31b800 from 30 10000000:01000000:3.0:1787378064.439122:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787378064.439146:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.439154:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.439184:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378064.439196:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561792:0@lo:101: 00000100:00100000:3.0:1787378064.439224:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.439251:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.439294:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626561792 00000100:00100000:2.0:1787378064.439299:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626561792 00000100:00100000:2.0:1787378064.439320:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787378064.439326:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626561792:12345-0@lo:101: 00010000:00010000:2.0:1787378064.439335:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378064.439350:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852b9a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378064.439401:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378064.439433:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378064.439442:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7600, rc 0) 00000100:00100000:2.0:1787378064.439482:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626561792:12345-0@lo:101: Request processed in 156us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.439487:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787378064.439545:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561792:0@lo:101: 00010000:00010000:3.0:1787378064.439556:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.439565:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378064.439604:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561920:0@lo:501: 00000100:00100000:3.0:1787378064.439627:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.439648:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.441000:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626561920 00000100:00100000:2.0:1787378064.441009:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626561920 00000100:00100000:2.0:1787378064.441051:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787378064.441058:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626561920:12345-0@lo:501: 00000100:00100000:2.0:1787378064.441323:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626561920:12345-0@lo:501: Request processed in 263us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.441330:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787378064.442008:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626561920:0@lo:501: 00000100:00100000:3.0:1787378064.442054:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562048:0@lo:503: 00000100:00100000:3.0:1787378064.442098:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.442129:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.442620:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626562048 00000100:00100000:2.0:1787378064.442625:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626562048 00000100:00100000:2.0:1787378064.442670:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787378064.442678:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626562048:12345-0@lo:503: 00000100:00100000:3.0:1787378064.443031:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562048:0@lo:503: 00000100:00100000:2.0:1787378064.443980:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626562048:12345-0@lo:503: Request processed in 1298us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.443991:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787378064.444285:0:7941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7941:1874201626562176:0@lo:502: 00000100:00100000:2.0:1787378064.444343:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378064.444393:0:7941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb855e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787378064.446261:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626562176 00000100:00100000:0.0:1787378064.446273:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626562176 00000100:00100000:0.0:1787378064.446336:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787378064.446345:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:7941:x1874201626562176:12345-0@lo:502: 00000100:00100000:0.0:1787378064.446632:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:7941:x1874201626562176:12345-0@lo:502: Request processed in 286us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378064.446639:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787378064.446655:0:7941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7941:1874201626562176:0@lo:502: 00000100:00100000:2.0:1787378064.446748:0:7941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7941:1874201626562304:0@lo:502: 00000100:00100000:2.0:1787378064.446790:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378064.446820:0:7941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987a56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.446919:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626562304 00000100:00100000:3.0:1787378064.446924:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626562304 00000100:00100000:3.0:1787378064.446953:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787378064.446960:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:7941:x1874201626562304:12345-0@lo:502: 00000100:00100000:3.0:1787378064.447236:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:7941:x1874201626562304:12345-0@lo:502: Request processed in 147us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.447244:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787378064.449247:0:7941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7941:1874201626562304:0@lo:502: 00000040:00080000:0.0:1787378064.449288:0:7941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787378064.450202:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787378064.450225:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787378064.450235:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.450247:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378064.450255:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787378064.450258:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9eeb8a31b800 from 5 10000000:01000000:3.0:1787378064.450260:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787378064.450293:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.450302:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.450311:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378064.450330:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562432:0@lo:101: 00000100:00100000:3.0:1787378064.450392:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.450462:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84565cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378064.450523:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626562432 00000100:00100000:0.0:1787378064.450530:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626562432 00000100:00100000:0.0:1787378064.450609:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787378064.450617:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626562432:12345-0@lo:101: 00010000:00010000:0.0:1787378064.450638:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378064.450652:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128b200/0xdd3c5462d7852baf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852ba8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.450672:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128b200/0xdd3c5462d7852baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852ba8 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.450681:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128b200/0xdd3c5462d7852baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852ba8 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.450689:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b200, rc 0) 00000100:00100000:0.0:1787378064.450747:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626562432:12345-0@lo:101: Request processed in 130us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378064.450764:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787378064.450887:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562432:0@lo:101: 00010000:00010000:3.0:1787378064.450899:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.450916:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378064.450958:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562560:0@lo:256: 00000100:00100000:3.0:1787378064.450987:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.451382:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84565cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.451426:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626562560 00000100:00100000:2.0:1787378064.451431:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626562560 00000100:00100000:2.0:1787378064.451454:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787378064.451461:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626562560:12345-0@lo:256: 20000000:01000000:2.0:1787378064.451474:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787378064.451491:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787378064.451494:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787378064.451593:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626562560:12345-0@lo:256: Request processed in 131us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.451599:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787378064.451702:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562560:0@lo:256: 10000000:01000000:1.0:1787378064.451779:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787378064.451786:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378064.451794:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378064.451801:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787378064.451804:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787378064.451806:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787378064.451826:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378064.451832:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378064.451839:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378064.451858:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562688:0@lo:101: 00000100:00100000:1.0:1787378064.451886:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.451913:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba86830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378064.452055:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626562688 00000100:00100000:0.0:1787378064.452059:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626562688 00000100:00100000:0.0:1787378064.452090:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787378064.452097:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626562688:12345-0@lo:101: 00010000:00010000:0.0:1787378064.452104:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378064.452124:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852bb6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.452140:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.452149:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.452156:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128bc00, rc 0) 00000100:00100000:0.0:1787378064.452196:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626562688:12345-0@lo:101: Request processed in 100us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378064.452202:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787378064.452230:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562688:0@lo:101: 00010000:00010000:0.0:1787378064.452239:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378064.452247:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378064.452290:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562816:0@lo:501: 00000100:00100000:0.0:1787378064.452322:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378064.452336:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787378064.452347:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626562816 00000100:00100000:0.0:1787378064.452350:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626562816 00000100:00100000:0.0:1787378064.452367:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787378064.452372:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626562816:12345-0@lo:501: 00000100:00100000:0.0:1787378064.452599:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626562816:12345-0@lo:501: Request processed in 226us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378064.452606:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787378064.453227:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562816:0@lo:501: 00000100:00100000:0.0:1787378064.453266:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562944:0@lo:503: 00000100:00100000:0.0:1787378064.453307:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378064.453338:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378064.453382:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626562944 00000100:00100000:2.0:1787378064.453387:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626562944 00000100:00100000:2.0:1787378064.453425:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787378064.453432:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626562944:12345-0@lo:503: 00000100:00100000:2.0:1787378064.454094:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626562944:12345-0@lo:503: Request processed in 660us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378064.454102:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787378064.454227:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626562944:0@lo:503: 00000100:00100000:2.0:1787378064.454535:0:7943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7943:1874201626563072:0@lo:502: 00000100:00100000:2.0:1787378064.454573:0:7943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378064.454800:0:7943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.454892:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626563072 00000100:00100000:3.0:1787378064.454898:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626563072 00000100:00100000:3.0:1787378064.455065:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787378064.455075:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:7943:x1874201626563072:12345-0@lo:502: 00000100:00100000:3.0:1787378064.455368:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:7943:x1874201626563072:12345-0@lo:502: Request processed in 294us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.455375:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787378064.455448:0:7943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7943:1874201626563072:0@lo:502: 00000020:01000000:0.0:1787378064.455478:0:7943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787378064.455487:0:7943:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787378064.455494:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378064.455497:0:7943:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787378064.455503:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787378064.455507:0:7943:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:0.0:1787378064.455527:0:7943:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787378064.455530:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787378064.455543:0:7943:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9eebb5383380) 00000020:00000080:0.0:1787378064.455562:0:7943:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787378064.455568:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787378064.455645:0:7943:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787378064.455650:0:7943:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787378064.455662:0:7943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7852bcb 00010000:00080000:0.0:1787378064.455695:0:7943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eebad27e800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1787378064.456106:0:7943:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787378064.456555:0:7943:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787378064.456566:0:7943:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787378064.457268:0:7943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787378064.457473:0:7943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787378064.457518:0:7943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787378064.457575:0:7943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787378064.458274:0:7944:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787378064.458280:0:7944:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787378064.459278:0:7943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787378064.459290:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787378064.459321:0:7943:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787378064.459344:0:7943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7852bd2 00000100:00080000:3.0:1787378064.459356:0:7943:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787378064.459362:0:7943:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eebad27e800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787378064.459394:0:7943:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebade83b80 x1874201626563200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787378064.459423:0:7943:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787378064.459506:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626563328:0@lo:400: 00000100:00100000:3.0:1787378064.459565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.459603:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787378064.459609:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626563456:0@lo:400: 00000100:00100000:3.0:1787378064.459630:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.459658:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626563584:0@lo:400: 00000100:00100000:3.0:1787378064.459682:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.459699:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787378064.459704:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626563712:0@lo:400: 00000100:00100000:3.0:1787378064.459765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.459794:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626563328 00000100:00100000:3.0:1787378064.459801:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626563328 00000100:00100000:3.0:1787378064.459833:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626563456 00000100:00100000:3.0:1787378064.459836:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626563456 00000100:00100000:3.0:1787378064.459857:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626563712 00000100:00100000:3.0:1787378064.459860:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626563712 00000100:00100000:3.0:1787378064.459875:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787378064.459882:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626563328:12345-0@lo:400: 00000100:00100000:3.0:1787378064.459940:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626563328:12345-0@lo:400: Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.459947:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787378064.459960:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787378064.459966:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626563456:12345-0@lo:400: 00000100:00100000:3.0:1787378064.459992:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626563456:12345-0@lo:400: Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.459997:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787378064.460007:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787378064.460012:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626563712:12345-0@lo:400: 00000100:00100000:3.0:1787378064.460040:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626563712:12345-0@lo:400: Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.460053:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787378064.460075:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626563584 00000100:00100000:3.0:1787378064.460078:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626563584 00000100:00100000:3.0:1787378064.460103:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787378064.460108:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626563584:12345-0@lo:400: 00000100:00100000:3.0:1787378064.460138:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626563584:12345-0@lo:400: Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.460143:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787378064.460160:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787378064.460174:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787378064.460201:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebade82680 x1874201626563712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378064.460214:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626563712:0@lo:400: 00010000:00080000:3.0:1787378064.460225:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebade83800 x1874201626563584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378064.460232:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626563584:0@lo:400: 00010000:00080000:3.0:1787378064.460262:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebade83480 x1874201626563456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378064.460270:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626563456:0@lo:400: 00010000:00080000:3.0:1787378064.460279:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebade81180 x1874201626563328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378064.460285:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626563328:0@lo:400: 00000020:01000000:3.0:1787378064.460334:0:7943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378064.460338:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378064.460345:0:7943:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787378064.460349:0:7943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787378064.460353:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378064.460354:0:7943:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787378064.460357:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787378064.460358:0:7943:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787378064.460382:0:7943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7943:1874201626563840:0@lo:502: 00000100:00100000:3.0:1787378064.460423:0:7943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.460446:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626563840 00000100:00100000:3.0:1787378064.460449:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626563840 00000100:00100000:3.0:1787378064.460475:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787378064.460481:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:7943:x1874201626563840:12345-0@lo:502: 00000100:00100000:3.0:1787378064.460688:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:7943:x1874201626563840:12345-0@lo:502: Request processed in 206us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.460695:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787378064.460759:0:7943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.460772:0:7943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:7943:1874201626563840:0@lo:502: 00000020:01000000:3.0:1787378064.460791:0:7943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378064.460795:0:7943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378064.460796:0:7943:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787378064.460800:0:7943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787378064.460846:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787378064.460865:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787378064.460874:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.460884:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378064.460892:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787378064.460900:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9eeb882799c0 from 1 10000000:01000000:3.0:1787378064.460903:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787378064.460925:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.460932:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.460941:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378064.460952:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626563968:0@lo:101: 00000100:00100000:3.0:1787378064.460975:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.460987:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.460999:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626563968 00000100:00100000:3.0:1787378064.461002:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626563968 00000100:00100000:3.0:1787378064.461021:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787378064.461026:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626563968:12345-0@lo:101: 00010000:00010000:3.0:1787378064.461033:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378064.461044:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852bd9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.461061:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.461070:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.461078:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546200, rc 0) 00000100:00100000:3.0:1787378064.461101:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626563968:12345-0@lo:101: Request processed in 75us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.461114:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787378064.461142:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626563968:0@lo:101: 00010000:00010000:3.0:1787378064.461153:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.461161:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378064.461209:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626564096:0@lo:501: 00000100:00100000:3.0:1787378064.461229:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.461239:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.461254:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626564096 00000100:00100000:3.0:1787378064.461257:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626564096 00000100:00100000:3.0:1787378064.461273:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787378064.461278:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626564096:12345-0@lo:501: 00000100:00100000:3.0:1787378064.461470:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626564096:12345-0@lo:501: Request processed in 190us (239us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787378064.461477:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787378064.461503:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626564096:0@lo:501: 10000000:01000000:3.0:1787378064.461519:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787378064.461524:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378064.461531:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378064.461848:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626563200:0@lo:8: 00000100:00100000:0.0:1787378064.461884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.462014:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626563200 00000100:00100000:3.0:1787378064.462024:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626563200 00000100:00100000:3.0:1787378064.462052:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787378064.462057:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1874201626563200:12345-0@lo:8: 00010000:00080000:3.0:1787378064.462076:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1787378064.462098:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7852be7 00002000:00100000:3.0:1787378064.462111:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9eea821c3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113675 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787378064.462115:0:6588:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787378064.462119:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787378064.462228:0:6588:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787378064.462368:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787378064.462389:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9eea821c6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787378064.462429:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874201626563200:12345-0@lo:8: Request processed in 371us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.462435:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787378064.462467:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebade83b80 x1874201626563200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787378074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378064.462476:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787378064.462482:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787378064.462488:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787378064.462492:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787378064.462495:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebad27e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787378064.462507:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787378064.462511:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626563200:0@lo:8: 00000004:00080000:2.0:1787378064.462690:0:7944:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787378064.462920:0:7944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 200725199041ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787378064.551620:0:7945:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787378064.552076:0:7945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7945:1874201626564352:0@lo:7: 00000100:00100000:1.0:1787378064.552144:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.552203:0:7945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1787378064.552238:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787378064.552266:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626564224:0@lo:13: 00000100:00100000:1.0:1787378064.552291:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.552330:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626564352 00000100:00100000:1.0:1787378064.552337:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626564352 00000100:00100000:1.0:1787378064.552390:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787378064.552399:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7945:x1874201626564352:12345-0@lo:7: 00000100:00080000:0.0:1787378064.555077:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787378064.555103:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626564224 00000100:00100000:0.0:1787378064.555113:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626564224 00000100:00100000:0.0:1787378064.555174:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787378064.555185:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626564224:12345-0@lo:13: 00002000:00000024:0.0:1787378064.555217:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787378064.555295:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626564224:12345-0@lo:13: Request processed in 112us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378064.555304:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787378064.562201:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae98b480 x1874201626564224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378064.562228:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626564224:0@lo:13: 00002000:00080000:1.0:1787378064.566655:0:6586:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787378064.566663:0:6586:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787378064.566787:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7945:x1874201626564352:12345-0@lo:7: Request processed in 14385us (14638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378064.566797:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787378064.566854:0:7945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae989c00 x1874201626564352/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787378080 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378064.566870:0:7945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7945:1874201626564352:0@lo:7: 00000004:00080000:1.0:1787378064.566883:0:7945:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787378064.566918:0:7945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7945:1874201626564480:0@lo:5: 00000100:00100000:1.0:1787378064.566946:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.566989:0:7945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378064.567139:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626564480 00000100:00100000:1.0:1787378064.567144:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626564480 00000100:00100000:1.0:1787378064.573689:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378064.573708:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7945:x1874201626564480:12345-0@lo:5: 00002000:00080000:1.0:1787378064.573758:0:6589:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787378064.573762:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787378064.574130:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7945:x1874201626564480:12345-0@lo:5: Request processed in 430us (7182us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787378064.574139:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787378064.574226:0:7945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae989c00 x1874201626564480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787378080 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378064.574242:0:7945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7945:1874201626564480:0@lo:5: 00000004:00080000:1.0:1787378064.574254:0:7945:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787378064.574291:0:7945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7945:1874201626564608:0@lo:700: 00000100:00100000:1.0:1787378064.574323:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378064.574364:0:7945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.574464:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626564608 00000100:00100000:3.0:1787378064.574473:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626564608 00000100:00100000:3.0:1787378064.574516:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787378064.574524:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7945:x1874201626564608:12345-0@lo:700: 00000100:00100000:3.0:1787378064.574563:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6595:1874201626564736:0@lo:700: 00000100:00100000:3.0:1787378064.574592:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378064.574609:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378064.574623:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626564736 00000100:00100000:3.0:1787378064.574626:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626564736 00000100:00100000:3.0:1787378064.574651:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787378064.574658:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6595:x1874201626564736:12345-0@lo:700: 40000000:02000000:1.0:1787378064.617573:0:5797:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787378064.620882:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6595:x1874201626564736:12345-0@lo:700: Request processed in 46216us (46281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378064.620898:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787378064.621957:0:6595:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebade83b80 x1874201626564736/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787378080 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378064.621975:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6595:1874201626564736:0@lo:700: 40000000:02000000:2.0:1787378064.621989:0:6595:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787378064.682674:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787378064.682701:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787378064.682870:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7945:x1874201626564608:12345-0@lo:700: Request processed in 108342us (108540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378064.682882:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787378064.682955:0:7945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae98b100 x1874201626564608/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787378080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378064.682971:0:7945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7945:1874201626564608:0@lo:700: 00000004:02000040:0.0:1787378064.723201:0:7945:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787378064.727006:0:7945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae989f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7945:1874201626564864:0@lo:5: 00000100:00100000:1.0:1787378064.727067:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378064.727110:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626564864 00000100:00100000:1.0:1787378064.727116:0:7945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378064.727123:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626564864 00000100:00100000:0.0:1787378064.727186:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787378064.727196:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7945:x1874201626564864:12345-0@lo:5: 00002000:00080000:0.0:1787378064.731820:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787378064.731842:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787378064.735326:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7945:x1874201626564864:12345-0@lo:5: Request processed in 8124us (8250us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787378064.735344:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787378064.735573:0:7945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae989f80 x1874201626564864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787378080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378064.735588:0:7945:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787378064.735603:0:7945:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9eebae989f80 x1874201626564864/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787378080 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378064.735614:0:7945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae989f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7945:1874201626564864:0@lo:5: 00000004:00080000:0.0:1787378064.735627:0:7945:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787378064.922361:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626564992:0@lo:13: 00000100:00100000:3.0:1787378064.922504:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378064.923123:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626564992 00000100:00100000:0.0:1787378064.923132:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626564992 00000100:00100000:0.0:1787378064.923294:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378064.923304:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626564992:12345-0@lo:13: 00002000:00000024:0.0:1787378064.923341:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378064.923398:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626564992:12345-0@lo:13: Request processed in 95us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378064.923404:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787378064.923473:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae988a80 x1874201626564992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378064.923488:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626564992:0@lo:13: 00010000:00010000:1.0:1787378065.372952:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378066.397911:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787378066.627848:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787378067.418081:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378068.287287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378068.287529:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604522368 00000100:00100000:3.0:1787378068.287544:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604522368 00000100:00100000:3.0:1787378068.287604:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:3.0:1787378068.287614:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1874201604522368:12345-192.168.203.22@tcp:250: 00010000:00080000:3.0:1787378068.287655:0:5786:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7a49b169-b438-4a59-90b0-00ee704ad017@192.168.203.22@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1787378068.287694:0:5786:0:(genops.c:1406:class_connect()) connect: client 7a49b169-b438-4a59-90b0-00ee704ad017, cookie 0xdd3c5462d7852bee 00000100:00080000:3.0:1787378068.287936:0:5786:0:(import.c:65:import_set_state_nolock()) ffff9eea821c0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787378068.288266:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+5:2352:x1874201604522368:12345-192.168.203.22@tcp:250: Request processed in 651us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378068.288295:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:0.0:1787378068.295336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378068.295760:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604522240 00000100:00100000:2.0:1787378068.295773:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604522240 00000100:00100000:2.0:1787378068.295852:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:2.0:1787378068.295864:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+5:5556:x1874201604522240:12345-192.168.203.22@tcp:101: 00010000:00010000:2.0:1787378068.295885:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378068.295921:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ce5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378068.296103:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378068.296120:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378068.296130:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6e00, rc 0) 00000100:00100000:2.0:1787378068.296219:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+6:5556:x1874201604522240:12345-192.168.203.22@tcp:101: Request processed in 356us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378068.296227:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:1.0:1787378068.301777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378068.301971:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604522496 00000100:00100000:0.0:1787378068.301983:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604522496 00000100:00100000:0.0:1787378068.302057:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:0.0:1787378068.302069:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+6:5556:x1874201604522496:12345-192.168.203.22@tcp:501: 00000100:00100000:0.0:1787378068.303774:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+6:5556:x1874201604522496:12345-192.168.203.22@tcp:501: Request processed in 1695us (2088us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787378068.303790:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:0.0:1787378068.310952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378068.311096:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604522624 00000100:00100000:3.0:1787378068.311110:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604522624 00000100:00100000:3.0:1787378068.312096:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:3.0:1787378068.312115:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+6:5556:x1874201604522624:12345-192.168.203.22@tcp:101: 00010000:00010000:3.0:1787378068.312146:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378068.312174:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6cec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378068.312214:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378068.312227:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378068.312239:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04e00, rc 0) 00000100:00100000:3.0:1787378068.312329:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+7:5556:x1874201604522624:12345-192.168.203.22@tcp:101: Request processed in 221us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378068.312338:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:2.0:1787378068.323044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378068.323165:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604522752 00000100:00100000:0.0:1787378068.323178:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604522752 00000100:00100000:0.0:1787378068.323252:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:0.0:1787378068.323634:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+7:5556:x1874201604522752:12345-192.168.203.22@tcp:501: 00000100:00100000:0.0:1787378068.330175:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+8:5556:x1874201604522752:12345-192.168.203.22@tcp:501: Request processed in 3769us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378068.330199:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:1.0:1787378068.333942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378068.334099:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604522880 00000100:00100000:3.0:1787378068.334113:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604522880 00000100:00100000:3.0:1787378068.334197:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:3.0:1787378068.334208:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+8:5556:x1874201604522880:12345-192.168.203.22@tcp:503: 00000100:00100000:3.0:1787378068.334680:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+8:5556:x1874201604522880:12345-192.168.203.22@tcp:503: Request processed in 471us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378068.334689:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:2.0:1787378068.350602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378068.350885:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604523008 00000100:00100000:0.0:1787378068.350898:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604523008 00000100:00100000:0.0:1787378068.351072:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:0.0:1787378068.351085:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb87629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+8:5575:x1874201604523008:12345-192.168.203.22@tcp:502: 00000100:00100000:0.0:1787378068.351679:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb87629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+8:5575:x1874201604523008:12345-192.168.203.22@tcp:502: Request processed in 594us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378068.351688:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:0.0:1787378068.387160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378068.387705:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604523136 00000100:00100000:2.0:1787378068.387764:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604523136 00000100:00100000:2.0:1787378068.388343:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:2.0:1787378068.388357:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+8:5575:x1874201604523136:12345-192.168.203.22@tcp:502: 00000100:00100000:2.0:1787378068.388786:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+8:5575:x1874201604523136:12345-192.168.203.22@tcp:502: Request processed in 430us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378068.388796:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:1.0:1787378068.405104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378068.405442:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604523264 00000100:00100000:0.0:1787378068.405457:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604523264 00000100:00100000:0.0:1787378068.405530:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1787378068.405542:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb87628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+8:5556:x1874201604523264:12345-192.168.203.22@tcp:101: 00010000:00010000:0.0:1787378068.405564:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378068.405587:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128b000/0xdd3c5462d7852c03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d16 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378068.405650:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128b000/0xdd3c5462d7852c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d16 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378068.405663:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128b000/0xdd3c5462d7852c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d16 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378068.405675:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b000, rc 0) 00000100:00100000:1.0:1787378068.408798:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb87628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+9:5556:x1874201604523264:12345-192.168.203.22@tcp:101: Request processed in 3237us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378068.408818:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1787378068.420786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378068.421094:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604523392 00000100:00100000:2.0:1787378068.421107:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604523392 00000100:00100000:2.0:1787378068.421188:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:2.0:1787378068.421199:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+9:5556:x1874201604523392:12345-192.168.203.22@tcp:256: 20000000:01000000:2.0:1787378068.421236:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787378068.421263:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787378068.421267:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787378068.421271:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787378068.421273:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787378068.427897:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+9:5556:x1874201604523392:12345-192.168.203.22@tcp:256: Request processed in 6612us (7039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378068.427916:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:1.0:1787378068.433457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378068.433577:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604523520 00000100:00100000:3.0:1787378068.433605:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604523520 00000100:00100000:3.0:1787378068.433745:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:3.0:1787378068.433757:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+9:5556:x1874201604523520:12345-192.168.203.22@tcp:101: 00010000:00010000:3.0:1787378068.433777:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378068.433800:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d1d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378068.433849:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378068.433863:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378068.433874:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04800, rc 0) 00000100:00100000:3.0:1787378068.434064:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:5556:x1874201604523520:12345-192.168.203.22@tcp:101: Request processed in 308us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378068.434073:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:0.0:1787378068.440619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378068.440759:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604523648 00000100:00100000:2.0:1787378068.440772:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604523648 00010000:00010000:1.0:1787378068.442390:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378068.444073:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:2.0:1787378068.444105:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:5556:x1874201604523648:12345-192.168.203.22@tcp:501: 00000100:00100000:2.0:1787378068.444801:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:5556:x1874201604523648:12345-192.168.203.22@tcp:501: Request processed in 706us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378068.444811:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:2.0:1787378068.448596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378068.448799:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604523776 00000100:00100000:3.0:1787378068.448812:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604523776 00000100:00100000:3.0:1787378068.449049:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:3.0:1787378068.449062:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:5556:x1874201604523776:12345-192.168.203.22@tcp:503: 00000100:00100000:3.0:1787378068.449577:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:5556:x1874201604523776:12345-192.168.203.22@tcp:503: Request processed in 515us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378068.449587:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:1.0:1787378068.462027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378068.462240:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604523904 00000100:00100000:2.0:1787378068.462253:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604523904 00000100:00100000:2.0:1787378068.462485:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:2.0:1787378068.462498:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:5579:x1874201604523904:12345-192.168.203.22@tcp:502: 00000100:00100000:2.0:1787378068.463224:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:5579:x1874201604523904:12345-192.168.203.22@tcp:502: Request processed in 723us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378068.463236:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:2.0:1787378068.466040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378068.466996:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604524032 00000100:00100000:3.0:1787378068.467011:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604524032 00000100:00100000:3.0:1787378068.467084:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:3.0:1787378068.467095:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:5579:x1874201604524032:12345-192.168.203.22@tcp:502: 00000100:00100000:3.0:1787378068.467780:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:5579:x1874201604524032:12345-192.168.203.22@tcp:502: Request processed in 684us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378068.467791:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:0.0:1787378068.474058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378068.474630:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604524160 00000100:00100000:3.0:1787378068.474644:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604524160 00000100:00100000:3.0:1787378068.474829:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1787378068.474840:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1874201604524160:12345-192.168.203.22@tcp:38: 00010000:00080000:3.0:1787378068.474884:0:5791:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1787378068.474959:0:5791:0:(genops.c:1406:class_connect()) connect: client 3ca7eed4-13a1-4f52-9d12-97b20fe7905e, cookie 0xdd3c5462d7852c11 00000004:00100000:3.0:1787378068.475002:0:5791:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787378068.475009:0:5791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787378068.536695:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9eebad27f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378068.536845:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2352:x1874201604524160:12345-192.168.203.22@tcp:38: Request processed in 62004us (62801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378068.536858:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00010000:00010000:3.0:1787378069.470490:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378069.530139:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626565376:0@lo:400: 00000100:00100000:2.0:1787378069.530236:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378069.530311:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378069.530318:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626565504:0@lo:400: 00000100:00100000:2.0:1787378069.530349:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378069.530418:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626565504 00000100:00100000:2.0:1787378069.530427:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626565504 00000100:00100000:2.0:1787378069.530496:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787378069.530507:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626565504:12345-0@lo:400: 00000100:00100000:2.0:1787378069.530569:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626565504:12345-0@lo:400: Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378069.530576:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787378069.530622:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eeb9a238a80 x1874201626565504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378069.530637:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626565504:0@lo:400: 00000100:00100000:0.0:1787378069.531068:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626565120:0@lo:400: 00000100:00100000:0.0:1787378069.531114:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378069.531159:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626565632:0@lo:400: 00000100:00100000:0.0:1787378069.531183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378069.531206:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787378069.531212:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626565248:0@lo:400: 00000100:00100000:0.0:1787378069.531234:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378069.531249:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626565760:0@lo:400: 00000100:00100000:0.0:1787378069.531272:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787378069.531296:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787378069.531311:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626565376 00000100:00100000:0.0:1787378069.531316:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626565376 00000100:00100000:0.0:1787378069.531362:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626565632 00000100:00100000:0.0:1787378069.531366:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626565632 00000100:00100000:0.0:1787378069.531380:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626565248 00000100:00100000:0.0:1787378069.531382:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626565248 00000100:00100000:0.0:1787378069.531395:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787378069.531400:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626565376:12345-0@lo:400: 00000100:00100000:0.0:1787378069.531442:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626565376:12345-0@lo:400: Request processed in 41us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378069.531449:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378069.531459:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626565760 00000100:00100000:0.0:1787378069.531461:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787378069.531463:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626565760 00000100:00100000:0.0:1787378069.531466:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626565632:12345-0@lo:400: 00000100:00100000:1.0:1787378069.531493:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378069.531494:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626565632:12345-0@lo:400: Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378069.531500:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626565760:12345-0@lo:400: 00000100:00100000:0.0:1787378069.531500:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787378069.531510:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787378069.531515:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626565248:12345-0@lo:400: 00000100:00100000:0.0:1787378069.531535:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626565248:12345-0@lo:400: Request processed in 20us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378069.531541:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787378069.531548:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626565760:12345-0@lo:400: Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378069.531553:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787378069.531554:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787378069.531557:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787378069.531577:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eeb9a23b800 x1874201626565248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378069.531589:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626565248:0@lo:400: 00010000:00080000:1.0:1787378069.531596:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eeb9a239180 x1874201626565376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787378069.531597:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae711c00 x1874201626565760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378069.531605:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787378069.531606:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626565376:0@lo:400: 00000100:00100000:0.0:1787378069.531622:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626565760:0@lo:400: 00010000:00080000:0.0:1787378069.531633:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae712a00 x1874201626565632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378069.531640:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626565632:0@lo:400: 00000100:00100000:2.0:1787378069.532656:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626565120 00000100:00100000:2.0:1787378069.532678:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626565120 00000100:00100000:2.0:1787378069.532749:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787378069.532758:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626565120:12345-0@lo:400: 00000100:00100000:2.0:1787378069.532838:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626565120:12345-0@lo:400: Request processed in 81us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378069.532845:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787378069.533004:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626565120:0@lo:400: 00000100:00100000:1.0:1787378069.558211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378069.558271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378069.558379:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604524288 00000100:00100000:2.0:1787378069.558392:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604524288 00000100:00100000:2.0:1787378069.558482:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604524416 00000100:00100000:2.0:1787378069.558486:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604524416 00000100:00100000:2.0:1787378069.558506:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1787378069.558516:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:0:x1874201604524288:12345-192.168.203.22@tcp:41: 00000004:00000024:2.0:1787378069.558578:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787378069.558673:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:0:x1874201604524288:12345-192.168.203.22@tcp:41: Request processed in 152us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378069.558682:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1787378069.558705:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787378069.558711:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5556:x1874201604524416:12345-192.168.203.22@tcp:41: 00000004:00000024:2.0:1787378069.558757:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787378069.558779:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5556:x1874201604524416:12345-192.168.203.22@tcp:41: Request processed in 68us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378069.558786:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00080000:1.0:1787378069.559146:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378069.579868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378069.582201:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604524544 00000100:00100000:1.0:1787378069.582247:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604524544 00000100:00100000:1.0:1787378069.582333:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787378069.582347:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5556:x1874201604524544:12345-192.168.203.22@tcp:40: 00000100:00100000:1.0:1787378069.582477:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5556:x1874201604524544:12345-192.168.203.22@tcp:40: Request processed in 132us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378069.582486:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1787378069.592429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378069.592479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378069.592518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378069.592557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378069.592596:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604524672 00000100:00100000:0.0:1787378069.592602:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604525056 00000100:00100000:0.0:1787378069.592609:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604525056 00000100:00100000:3.0:1787378069.592610:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604524672 00000100:00100000:0.0:1787378069.592663:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:3.0:1787378069.592668:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604524800 00000100:00100000:3.0:1787378069.592672:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604524800 00000100:00100000:3.0:1787378069.592690:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787378069.592698:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874201604524672:12345-192.168.203.22@tcp:8: 00010000:00080000:3.0:1787378069.592767:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1787378069.592806:0:6586:0:(genops.c:1406:class_connect()) connect: client 3ca7eed4-13a1-4f52-9d12-97b20fe7905e, cookie 0xdd3c5462d7852c18 00002000:00100000:3.0:1787378069.592821:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ca7eed4-13a1-4f52-9d12-97b20fe7905e/ffff9eea821c4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787378069.592852:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787378069.593024:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2354:x1874201604525056:12345-192.168.203.22@tcp:400: 00000100:00100000:0.0:1787378069.593111:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2354:x1874201604525056:12345-192.168.203.22@tcp:400: Request processed in 91us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378069.593119:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00002000:00080000:0.0:1787378069.594406:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787378069.594451:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eebad27d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378069.594522:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2352:x1874201604524672:12345-192.168.203.22@tcp:8: Request processed in 1823us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378069.594531:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1787378069.594571:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:0.0:1787378069.594577:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874201604524800:12345-192.168.203.22@tcp:8: 00010000:00080000:0.0:1787378069.594602:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1787378069.594630:0:6586:0:(genops.c:1406:class_connect()) connect: client 3ca7eed4-13a1-4f52-9d12-97b20fe7905e, cookie 0xdd3c5462d7852c1f 00002000:00100000:0.0:1787378069.594641:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ca7eed4-13a1-4f52-9d12-97b20fe7905e/ffff9eebad27b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787378069.594687:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787378069.594954:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787378069.595219:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eebad27c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378069.595255:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2352:x1874201604524800:12345-192.168.203.22@tcp:8: Request processed in 676us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378069.595262:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787378069.598399:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604524928 00000100:00100000:1.0:1787378069.598418:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604524928 00000100:00100000:1.0:1787378069.598502:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787378069.598515:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5556:x1874201604524928:12345-192.168.203.22@tcp:33: 00000004:00080000:1.0:1787378069.629170:0:5793:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30565us 00000004:00200000:3.0:1787378069.646614:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787378069.647418:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5556:x1874201604524928:12345-192.168.203.22@tcp:33: Request processed in 48897us (54997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378069.647448:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787378069.857207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378069.857297:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604525184 00000100:00100000:3.0:1787378069.857307:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604525184 00000100:00100000:3.0:1787378069.857374:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787378069.857384:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5595:x1874201604525184:12345-192.168.203.22@tcp:101: 00010000:00010000:3.0:1787378069.857404:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378069.857474:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04a00/0xdd3c5462d7852c26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d47 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378069.857538:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852c2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378069.857553:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378069.857567:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378069.858009:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787378069.858015:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378069.858094:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378069.858122:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04a00/0xdd3c5462d7852c26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d47 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378069.858152:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852c2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d47 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378069.858175:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4c00) 00010000:00010000:3.0:1787378069.858178:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378069.858181:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04000, rc 0) 00000100:00100000:3.0:1787378069.858251:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:5595:x1874201604525184:12345-192.168.203.22@tcp:101: Request processed in 868us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378069.858259:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787378070.042713:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787378070.042755:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626565888:0@lo:13: 00000100:00100000:3.0:1787378070.042826:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378070.043277:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626566016:0@lo:13: 00000100:00100000:3.0:1787378070.043308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378070.043395:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626565888 00000100:00100000:0.0:1787378070.043403:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626565888 00000100:00100000:0.0:1787378070.043440:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626566016 00000100:00100000:0.0:1787378070.043443:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626566016 00000100:00100000:0.0:1787378070.043459:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787378070.043468:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626565888:12345-0@lo:13: 00002000:00000024:0.0:1787378070.043490:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378070.043549:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626565888:12345-0@lo:13: Request processed in 81us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378070.043557:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787378070.043574:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787378070.043592:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626566016:12345-0@lo:13: 00002000:00000024:0.0:1787378070.043603:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378070.043629:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626566016:12345-0@lo:13: Request processed in 49us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378070.043635:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787378070.044068:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c7b80 x1874201626566016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378070.044087:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626566016:0@lo:13: 00010000:00080000:3.0:1787378070.044099:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebaf44c000 x1874201626565888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378070.044110:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626565888:0@lo:13: 00010000:00010000:3.0:1787378070.490766:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787378071.111190:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00010000:00010000:1.0:1787378071.514650:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378072.021563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378072.022372:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604525312 00000100:00100000:2.0:1787378072.022444:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604525312 00000100:00100000:2.0:1787378072.022575:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787378072.022585:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:5649:x1874201604525312:12345-192.168.203.22@tcp:41: 00000004:00000024:2.0:1787378072.022626:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787378072.022703:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:5649:x1874201604525312:12345-192.168.203.22@tcp:41: Request processed in 120us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378072.022711:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00080000:1.0:1787378072.023872:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378072.031195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378072.031329:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604525440 00000100:00100000:0.0:1787378072.031340:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604525440 00000100:00100000:0.0:1787378072.031419:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1787378072.031428:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:5649:x1874201604525440:12345-192.168.203.22@tcp:13: 00002000:00000024:0.0:1787378072.031475:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378072.031540:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:5649:x1874201604525440:12345-192.168.203.22@tcp:13: Request processed in 113us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378072.031547:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00080000:1.0:1787378072.031777:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787378072.035558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378072.035660:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604525568 00000100:00100000:1.0:1787378072.035671:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604525568 00000100:00100000:1.0:1787378072.035772:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787378072.035782:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5649:x1874201604525568:12345-192.168.203.22@tcp:13: 00002000:00000024:1.0:1787378072.035820:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378072.035887:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:5649:x1874201604525568:12345-192.168.203.22@tcp:13: Request processed in 106us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378072.035895:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00080000:0.0:1787378072.036648:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787378072.538553:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787378072.648292:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00010000:00010000:3.0:1787378073.574747:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787378073.699160:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00010000:00010000:2.0:1787378074.590782:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378074.650934:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626566528:0@lo:400: 00000100:00100000:2.0:1787378074.651104:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626566272:0@lo:400: 00000100:00100000:2.0:1787378074.651162:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378074.651291:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626566784:0@lo:400: 00000100:00100000:2.0:1787378074.651318:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378074.651345:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787378074.651351:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626566144:0@lo:400: 00000100:00100000:2.0:1787378074.651375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378074.651401:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626566656:0@lo:400: 00000100:00100000:2.0:1787378074.651421:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378074.651450:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378074.651451:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626566272 00000100:00100000:2.0:1787378074.651468:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626566272 00000100:00100000:3.0:1787378074.651471:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787378074.651477:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626566400:0@lo:400: 00000100:00100000:3.0:1787378074.651505:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378074.651509:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626566656 00000100:00100000:2.0:1787378074.651512:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626566656 00000100:00100000:3.0:1787378074.651524:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626566784 00000100:00100000:3.0:1787378074.651527:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626566784 00000100:00100000:2.0:1787378074.651532:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626566400 00000100:00100000:2.0:1787378074.651535:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626566400 00000100:00100000:2.0:1787378074.651548:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787378074.651552:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626566528 00000100:00100000:3.0:1787378074.651554:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626566528 00000100:00100000:2.0:1787378074.651556:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626566272:12345-0@lo:400: 00000100:00100000:3.0:1787378074.651567:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787378074.651572:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626566784:12345-0@lo:400: 00000100:00100000:2.0:1787378074.651602:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626566272:12345-0@lo:400: Request processed in 46us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378074.651609:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787378074.651626:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787378074.651631:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626566656:12345-0@lo:400: 00000100:00100000:2.0:1787378074.651665:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626566656:12345-0@lo:400: Request processed in 34us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378074.651672:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787378074.651684:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787378074.651690:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626566400:12345-0@lo:400: 00000100:00100000:2.0:1787378074.651741:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626566400:12345-0@lo:400: Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378074.651747:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787378074.651764:0:6589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787378074.651771:0:6589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1787378074.651788:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378074.651792:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378074.651795:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378074.651832:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626566400:0@lo:400: 00000100:00100000:2.0:1787378074.651863:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626566656:0@lo:400: 00000100:00100000:2.0:1787378074.651872:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626566272:0@lo:400: 00000100:00100000:0.0:1787378074.652148:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626566144 00000100:00100000:0.0:1787378074.652153:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626566144 00000100:00100000:0.0:1787378074.652296:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787378074.652305:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626566144:12345-0@lo:400: 00000100:00100000:0.0:1787378074.652346:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626566144:12345-0@lo:400: Request processed in 43us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378074.652363:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787378074.652442:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626566784:12345-0@lo:400: Request processed in 869us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378074.652449:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787378074.652463:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787378074.652470:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626566528:12345-0@lo:400: 00000100:00100000:3.0:1787378074.652503:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626566528:12345-0@lo:400: Request processed in 34us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378074.652509:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787378074.652540:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebaf44c000 x1874201626566528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378074.652550:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626566528:0@lo:400: 00000100:00100000:0.0:1787378074.655043:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626566144:0@lo:400: 00010000:00080000:0.0:1787378074.655064:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50dd180 x1874201626566784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378074.655076:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626566784:0@lo:400: 00000100:00100000:3.0:1787378074.761947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378074.761989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378074.762023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378074.762048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378074.762075:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604525952 00000100:00100000:3.0:1787378074.762083:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604525952 00000100:00100000:3.0:1787378074.762141:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604526080 00000100:00100000:2.0:1787378074.762144:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604525824 00000100:00100000:3.0:1787378074.762145:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604526080 00000100:00100000:2.0:1787378074.762147:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604525824 00000100:00100000:3.0:1787378074.762176:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787378074.762186:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604525952:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1787378074.762187:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1787378074.762194:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604525824:12345-192.168.203.22@tcp:400: 00000100:00100000:0.0:1787378074.762286:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604525696 00000100:00100000:0.0:1787378074.762290:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604525696 00000100:00100000:0.0:1787378074.762316:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:0.0:1787378074.762323:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604525696:12345-192.168.203.22@tcp:400: 00000100:00100000:1.0:1787378074.762343:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787378074.762352:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604526080:12345-192.168.203.22@tcp:400: 00000100:00100000:3.0:1787378074.762385:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604525952:12345-192.168.203.22@tcp:400: Request processed in 200us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378074.762392:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00080000:3.0:1787378074.765378:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787378074.765388:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787378074.765392:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378074.768797:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604525824:12345-192.168.203.22@tcp:400: Request processed in 6589us (6759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378074.768813:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:0.0:1787378074.770571:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604525696:12345-192.168.203.22@tcp:400: Request processed in 8238us (8622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378074.770595:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:1.0:1787378074.772660:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604526080:12345-192.168.203.22@tcp:400: Request processed in 10298us (10599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378074.772690:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000001:02000400:3.0:1787378074.947388:0:8144:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787378075.164033:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787378075.164057:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626566912:0@lo:13: 00000100:00100000:0.0:1787378075.164136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378075.164208:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626566912 00000100:00100000:0.0:1787378075.164215:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626566912 00000100:00100000:0.0:1787378075.164263:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787378075.164272:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626566912:12345-0@lo:13: 00002000:00000024:0.0:1787378075.164305:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378075.164347:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626566912:12345-0@lo:13: Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378075.164354:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787378075.164391:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c4a80 x1874201626566912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378075.164407:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626566912:0@lo:13: 00000100:00100000:2.0:1787378075.167663:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626567040:0@lo:13: 00000100:00100000:2.0:1787378075.167763:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378075.167932:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626567040 00000100:00100000:1.0:1787378075.167939:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626567040 00000100:00100000:1.0:1787378075.167985:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787378075.167993:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626567040:12345-0@lo:13: 00002000:00000024:1.0:1787378075.168025:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378075.168067:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626567040:12345-0@lo:13: Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378075.168073:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787378075.171624:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae988a80 x1874201626567040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378075.171650:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626567040:0@lo:13: 00010000:00010000:3.0:1787378075.609967:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378076.634858:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378077.664265:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378078.692440:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787378078.788360:0:8293:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd006be3d0 00000020:00000080:2.0:1787378078.788376:0:8293:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787378078.788381:0:8293:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787378078.788390:0:8293:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd006c0660 20000000:00000080:2.0:1787378078.788396:0:8293:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eeb84554000 uarg=0000000000000000 20000000:01000000:2.0:1787378078.788483:0:8293:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787378078.788485:0:8293:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787378078.788487:0:8293:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787378078.788492:0:8293:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787378078.788497:0:8293:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787378078.788511:0:8293:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787378078.788513:0:8293:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787378078.788694:0:8293:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787378078.788697:0:8293:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787378078.789585:0:8294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787378078.790039:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787378078.790124:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787378078.790164:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787378078.790177:0:8293:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787378078.790179:0:8293:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787378078.790881:0:8295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787378078.791221:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787378078.791268:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787378078.791303:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787378078.791315:0:8293:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787378078.791317:0:8293:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787378078.792289:0:8296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787378078.792997:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787378078.793053:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787378078.793119:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787378078.793140:0:8293:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787378078.793143:0:8293:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787378078.793977:0:8297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787378078.794310:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787378078.794440:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787378078.794472:0:8293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:2.0:1787378078.794486:0:8293:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787378078.794507:0:8293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794526:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794534:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794540:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794547:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794552:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794558:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794564:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794573:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794591:0:8293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794599:0:8293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794633:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794647:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 9 pid: 5786 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.794662:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567168:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378078.794893:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794902:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 9 pid: 5783 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.794911:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae713480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567296:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378078.794944:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.794953:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 18 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.794962:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae710000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567424:0@lo:104: 00000100:00100000:2.0:1787378078.795003:0:8293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787378078.795051:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.795060:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 18 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.795078:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567552:0@lo:104: 00000100:00100000:2.0:1787378078.795101:0:8293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787378078.795124:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.795132:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 18 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.795140:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567680:0@lo:104: 00010000:00010000:2.0:1787378078.795160:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.795166:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 18 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.795173:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae710e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567808:0@lo:104: 00010000:00010000:2.0:1787378078.795189:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.795196:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 18 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.795202:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae713100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567936:0@lo:104: 00010000:00010000:2.0:1787378078.795223:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.795237:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 18 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.795245:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae712a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626568064:0@lo:104: 00010000:00010000:2.0:1787378078.795271:0:8293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378078.795279:0:8293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 18 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.795286:0:8293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626568192:0@lo:104: 00000100:00100000:2.0:1787378078.795302:0:8293:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84565e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378078.795426:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787378078.795444:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.795455:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.795463:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.795475:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.795496:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.795509:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626567424 00000100:00100000:1.0:1787378078.795516:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626567424 00000100:00100000:1.0:1787378078.795551:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626567552 00000100:00100000:1.0:1787378078.795553:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626567552 00000100:00100000:1.0:1787378078.795563:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626567680 00000100:00100000:1.0:1787378078.795565:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626567680 00000100:00100000:1.0:1787378078.795573:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626567808 00000100:00100000:1.0:1787378078.795575:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626567808 00000100:00100000:1.0:1787378078.795581:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626567936 00000100:00100000:1.0:1787378078.795583:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626567936 00000100:00100000:1.0:1787378078.795591:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626568064 00000100:00100000:1.0:1787378078.795598:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626568064 00000100:00100000:1.0:1787378078.795610:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626568192 00000100:00100000:1.0:1787378078.795613:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626568192 00000100:00100000:1.0:1787378078.795625:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787378078.795631:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:8293:x1874201626567424:12345-0@lo:104: 00010000:00010000:1.0:1787378078.795644:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.795708:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378078.795714:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+9:8293:x1874201626567424:12345-0@lo:104: Request processed in 83us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.795745:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787378078.795762:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787378078.795768:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf42a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+8:8293:x1874201626567552:12345-0@lo:104: 00010000:00010000:1.0:1787378078.795776:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.795808:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787378078.795813:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf42a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+8:8293:x1874201626567552:12345-0@lo:104: Request processed in 46us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.795819:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787378078.795849:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787378078.795856:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+7:8293:x1874201626567680:12345-0@lo:104: 00010000:00010000:1.0:1787378078.795863:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.795895:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787378078.795900:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+7:8293:x1874201626567680:12345-0@lo:104: Request processed in 46us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.795912:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787378078.795924:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787378078.795929:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+6:8293:x1874201626567808:12345-0@lo:104: 00010000:00010000:1.0:1787378078.795937:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.795962:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787378078.795967:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+6:8293:x1874201626567808:12345-0@lo:104: Request processed in 39us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.795972:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787378078.795983:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378078.795989:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:8293:x1874201626567936:12345-0@lo:104: 00010000:00010000:1.0:1787378078.795996:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796021:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787378078.796025:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:8293:x1874201626567936:12345-0@lo:104: Request processed in 38us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.796031:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378078.796041:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787378078.796046:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:8293:x1874201626568064:12345-0@lo:104: 00010000:00010000:1.0:1787378078.796053:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796089:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787378078.796093:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:8293:x1874201626568064:12345-0@lo:104: Request processed in 48us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.796104:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787378078.796116:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787378078.796122:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:8293:x1874201626568192:12345-0@lo:104: 00010000:00010000:1.0:1787378078.796129:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796154:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787378078.796159:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:8293:x1874201626568192:12345-0@lo:104: Request processed in 38us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.796163:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787378078.796180:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787378078.796185:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796192:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547400 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378078.796196:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796205:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378078.796213:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378078.796219:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378078.796249:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796256:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378078.796283:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796290:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81547400/0xdd3c5462d7852bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852be0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796304:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787378078.796307:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796313:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484c00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378078.796316:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796394:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378078.796402:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378078.796406:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378078.796421:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796427:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378078.796432:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796439:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81484c00/0xdd3c5462d7852bb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852bbd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796448:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787378078.796456:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796462:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546e00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378078.796465:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796472:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378078.796477:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378078.796482:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378078.796496:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796502:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378078.796517:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796524:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81546e00/0xdd3c5462d7852b9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852ba1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796532:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787378078.796535:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796541:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6c00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378078.796543:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796559:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378078.796565:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378078.796569:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378078.796582:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796587:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378078.796592:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796598:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6c00/0xdd3c5462d7852b8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b93 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796607:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787378078.796610:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796615:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378078.796617:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796623:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378078.796629:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378078.796639:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378078.796651:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796657:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378078.796661:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796667:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128be00/0xdd3c5462d7852b7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b85 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796674:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787378078.796677:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796682:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6400 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378078.796684:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796690:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378078.796695:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378078.796699:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378078.796707:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796711:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378078.796739:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796745:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6400/0xdd3c5462d7852b54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b5b expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796754:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378078.796757:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796763:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378078.796765:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796772:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378078.796777:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378078.796781:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378078.796794:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796799:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378078.796802:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796809:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852b2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b31 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.796821:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378078.796828:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378078.796830:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378078.796836:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378078.796842:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378078.796863:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626568320:0@lo:103: 00000100:00100000:1.0:1787378078.796897:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.796921:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626568832:0@lo:103: 00000100:00100000:1.0:1787378078.796939:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.796957:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787378078.796962:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626568448:0@lo:103: 00000100:00100000:1.0:1787378078.796981:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.796996:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626568960:0@lo:103: 00000100:00100000:1.0:1787378078.797014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.797041:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626568576:0@lo:103: 00000100:00100000:1.0:1787378078.797061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.797084:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626569088:0@lo:103: 00000100:00100000:1.0:1787378078.797101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.797110:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378078.797114:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626568704:0@lo:103: 00000100:00100000:1.0:1787378078.797131:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378078.797151:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626568320 00000100:00100000:1.0:1787378078.797156:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626568320 00010000:00010000:1.0:1787378078.797177:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 19 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378078.797192:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626568832 00000100:00100000:1.0:1787378078.797194:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626568832 00010000:00010000:1.0:1787378078.797204:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 20 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378078.797221:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626568448 00000100:00100000:1.0:1787378078.797224:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626568448 00010000:00010000:1.0:1787378078.797234:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 21 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378078.797242:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626568960 00000100:00100000:1.0:1787378078.797244:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626568960 00010000:00010000:1.0:1787378078.797253:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 22 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378078.797262:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626568576 00000100:00100000:1.0:1787378078.797264:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626568576 00010000:00010000:1.0:1787378078.797273:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 23 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378078.797282:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626569088 00000100:00100000:1.0:1787378078.797284:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626569088 00010000:00010000:1.0:1787378078.797293:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 24 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378078.797300:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626568704 00000100:00100000:1.0:1787378078.797302:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626568704 00010000:00010000:1.0:1787378078.797310:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 25 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378078.797321:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787378078.797679:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae710000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567424:0@lo:104: 00000100:00100000:2.0:1787378078.797688:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567552:0@lo:104: 00000100:00100000:2.0:1787378078.797695:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567680:0@lo:104: 00000100:00100000:2.0:1787378078.797702:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae710e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567808:0@lo:104: 00000100:00100000:2.0:1787378078.797710:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae713100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567936:0@lo:104: 00000100:00100000:2.0:1787378078.797741:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae712a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626568064:0@lo:104: 00000100:00100000:2.0:1787378078.797750:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626568192:0@lo:104: 00000100:00100000:1.0:1787378078.797895:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+25:3313:x1874201626568320:12345-0@lo:103: 00010000:00010000:1.0:1787378078.797907:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378078.797912:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 25 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.797933:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 25 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.797948:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852be0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852bd9 expref: 25 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.797960:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378078.798038:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+24:3313:x1874201626568320:12345-0@lo:103: Request processed in 148us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.798045:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787378078.798064:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787378078.798079:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+23:3313:x1874201626568832:12345-0@lo:103: 00010000:00010000:1.0:1787378078.798087:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378078.798092:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 23 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798100:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 23 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798110:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852b85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852b7e expref: 23 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798118:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378078.798140:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+22:3313:x1874201626568832:12345-0@lo:103: Request processed in 61us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.798146:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787378078.798158:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787378078.798164:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+21:3313:x1874201626568448:12345-0@lo:103: 00010000:00010000:1.0:1787378078.798176:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378078.798181:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 21 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798189:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 21 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798199:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128bc00/0xdd3c5462d7852bbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852bb6 expref: 21 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798207:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378078.798226:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3313:x1874201626568448:12345-0@lo:103: Request processed in 62us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.798231:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787378078.798241:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787378078.798246:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626568960:12345-0@lo:103: 00010000:00010000:1.0:1787378078.798252:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378078.798256:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 19 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798263:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 19 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798272:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852b5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852b54 expref: 19 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798280:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378078.798294:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:3313:x1874201626568960:12345-0@lo:103: Request processed in 48us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.798307:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787378078.798317:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378078.798333:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:3311:x1874201626568576:12345-0@lo:103: 00010000:00010000:1.0:1787378078.798340:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378078.798344:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 17 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798352:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 17 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798361:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c7600/0xdd3c5462d7852ba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852b9a expref: 17 pid: 5786 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798369:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378078.798398:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3311:x1874201626568576:12345-0@lo:103: Request processed in 75us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.798403:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378078.798413:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787378078.798418:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:3311:x1874201626569088:12345-0@lo:103: 00010000:00010000:1.0:1787378078.798425:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378078.798429:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 15 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798437:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 15 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798446:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852b31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852b2a expref: 15 pid: 5783 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798464:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378078.798485:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:3311:x1874201626569088:12345-0@lo:103: Request processed in 67us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.798491:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787378078.798503:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787378078.798508:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:3311:x1874201626568704:12345-0@lo:103: 00010000:00010000:1.0:1787378078.798516:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378078.798520:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 13 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798528:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 13 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798538:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81547200/0xdd3c5462d7852b93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852b8c expref: 13 pid: 5785 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378078.798546:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378078.798564:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3311:x1874201626568704:12345-0@lo:103: Request processed in 57us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378078.798570:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787378078.798739:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626568704:0@lo:103: 00000100:00100000:3.0:1787378078.798749:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626568576:0@lo:103: 00000100:00100000:3.0:1787378078.798756:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626569088:0@lo:103: 00000100:00100000:0.0:1787378078.801889:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567168:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378078.801905:0:8293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae713480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8293:1874201626567296:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378078.801950:0:8293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378078.803419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378078.803501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378078.803536:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604526208 00000100:00100000:3.0:1787378078.803544:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604526208 00010000:00010000:3.0:1787378078.803579:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 10 pid: 5786 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378078.803608:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604526336 00000100:00100000:3.0:1787378078.803612:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604526336 00010000:00010000:3.0:1787378078.803623:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 11 pid: 5783 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378078.803641:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1787378078.803650:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+11:2353:x1874201604526208:12345-192.168.203.22@tcp:103: 00010000:00010000:3.0:1787378078.803662:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378078.803681:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 11 pid: 5786 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803691:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 11 pid: 5786 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803707:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852bfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6cec expref: 11 pid: 5786 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803740:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378078.803787:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+10:2353:x1874201604526208:12345-192.168.203.22@tcp:103: Request processed in 138us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378078.803794:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1787378078.803809:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1787378078.803815:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+9:2353:x1874201604526336:12345-192.168.203.22@tcp:103: 00010000:00010000:3.0:1787378078.803822:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378078.803826:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 9 pid: 5783 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803834:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 9 pid: 5783 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803842:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852bf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ce5 expref: 9 pid: 5783 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803866:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803874:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803895:0:6603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803902:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803908:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803915:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803920:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378078.803924:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803931:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803942:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378078.803953:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378078.803973:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+8:2353:x1874201604526336:12345-192.168.203.22@tcp:103: Request processed in 158us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378078.803979:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00010000:00010000:0.0:1787378078.804184:0:8293:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378078.804193:0:8293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378078.804199:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c7c00/0xdd3c5462d7852c34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378078.806150:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626568320:0@lo:103: 00000100:00100000:2.0:1787378078.806179:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626568832:0@lo:103: 00000100:00100000:2.0:1787378078.806201:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626568448:0@lo:103: 00000100:00100000:2.0:1787378078.806209:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626568960:0@lo:103: 00010000:00010000:1.0:1787378079.706002:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378079.781894:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626569600:0@lo:400: 00000100:00100000:3.0:1787378079.781968:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378079.782041:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787378079.782070:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626569216:0@lo:400: 00000100:00100000:3.0:1787378079.782103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378079.782266:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626569344:0@lo:400: 00000100:00100000:0.0:1787378079.782272:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626569600 00000100:00100000:0.0:1787378079.782280:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626569600 00000100:00100000:3.0:1787378079.782326:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626569728:0@lo:400: 00000100:00100000:0.0:1787378079.782397:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787378079.782407:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626569600:12345-0@lo:400: 00000100:00100000:1.0:1787378079.782696:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626569472:0@lo:400: 00000100:00100000:2.0:1787378079.800176:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378079.800227:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626569856:0@lo:400: 00000100:00100000:2.0:1787378079.800280:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378079.800327:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626569344 00000100:00100000:2.0:1787378079.800335:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626569344 00000100:00100000:2.0:1787378079.800377:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787378079.800385:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626569344:12345-0@lo:400: 00000100:00100000:2.0:1787378079.800435:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626569344:12345-0@lo:400: Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378079.800442:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787378079.800462:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626569856 00000100:00100000:2.0:1787378079.800465:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626569856 00000100:00100000:2.0:1787378079.800499:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378079.800506:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626569856:12345-0@lo:400: 00000100:00100000:2.0:1787378079.800536:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626569856:12345-0@lo:400: Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378079.800542:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378079.800580:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626569344:0@lo:400: 00010000:00080000:2.0:1787378079.800595:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c4000 x1874201626569856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378079.800605:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626569856:0@lo:400: 00000100:00080000:2.0:1787378079.800652:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378079.800657:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378079.800678:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626569216 00000100:00100000:2.0:1787378079.800682:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626569216 00000100:00100000:2.0:1787378079.800748:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787378079.800755:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3311:x1874201626569216:12345-0@lo:400: 00000100:00100000:2.0:1787378079.800787:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:3311:x1874201626569216:12345-0@lo:400: Request processed in 33us (18683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378079.800793:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787378079.802546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378079.802889:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626569216:0@lo:400: 00000100:00100000:2.0:1787378079.803575:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626569728 00000100:00100000:2.0:1787378079.803583:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626569728 00000100:00100000:2.0:1787378079.803651:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787378079.803660:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626569728:12345-0@lo:400: 00000100:00100000:2.0:1787378079.803733:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626569728:12345-0@lo:400: Request processed in 60us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378079.803739:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787378079.806680:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378079.806788:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626569728:0@lo:400: 00000100:00100000:0.0:1787378079.808258:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626569600:12345-0@lo:400: Request processed in 25847us (26283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378079.808272:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787378079.808449:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c5180 x1874201626569600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378079.808532:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626569600:0@lo:400: 00000100:00100000:1.0:1787378079.825070:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378079.825655:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626569472 00000100:00100000:2.0:1787378079.825666:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626569472 00000100:00080000:3.0:1787378079.826001:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378079.826074:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787378079.826086:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626569472:12345-0@lo:400: 00000100:00100000:2.0:1787378079.826345:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626569472:12345-0@lo:400: Request processed in 262us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378079.826354:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787378079.831433:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626569472:0@lo:400: 00000100:00100000:3.0:1787378079.872261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378079.872294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378079.872331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378079.872370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378079.872397:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604526720 00000100:00100000:3.0:1787378079.872407:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604526720 00000100:00100000:3.0:1787378079.872644:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604526848 00000100:00100000:3.0:1787378079.872648:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604526848 00000100:00100000:3.0:1787378079.872677:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1787378079.872687:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604526720:12345-192.168.203.22@tcp:400: 00000100:00100000:3.0:1787378079.872956:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604526720:12345-192.168.203.22@tcp:400: Request processed in 269us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378079.872964:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1787378079.872981:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1787378079.872988:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604526848:12345-192.168.203.22@tcp:400: 00000100:00100000:3.0:1787378079.873029:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604526848:12345-192.168.203.22@tcp:400: Request processed in 42us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378079.873035:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:2.0:1787378079.873428:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604526592 00000100:00100000:2.0:1787378079.873433:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604526592 00000100:00100000:2.0:1787378079.873482:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:2.0:1787378079.873489:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604526592:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1787378079.873522:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604526592:12345-192.168.203.22@tcp:400: Request processed in 34us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378079.873528:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00080000:2.0:1787378079.873638:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378079.873649:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378079.873652:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378079.875152:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604526464 00000100:00100000:1.0:1787378079.875164:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604526464 00000100:00100000:1.0:1787378079.875211:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:1.0:1787378079.875230:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+8:2356:x1874201604526464:12345-192.168.203.22@tcp:400: 00000100:00100000:1.0:1787378079.875291:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+8:2356:x1874201604526464:12345-192.168.203.22@tcp:400: Request processed in 62us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378079.875298:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 10000000:01000000:3.0:1787378080.090134:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787378080.090142:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eebbb181000 from 39 10000000:01000000:3.0:1787378080.090147:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787378080.090209:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.090222:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.090232:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378080.090256:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626569984:0@lo:101: 00000100:00100000:3.0:1787378080.090328:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378080.090386:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb91ada6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378080.090814:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626569984 00000100:00100000:2.0:1787378080.090822:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626569984 00000100:00100000:2.0:1787378080.090881:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787378080.090890:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+12:5788:x1874201626569984:12345-0@lo:101: 00010000:00010000:2.0:1787378080.090918:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378080.090933:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c7a00/0xdd3c5462d7852c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852c3b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.090955:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c7a00/0xdd3c5462d7852c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852c3b expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.090965:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c7a00/0xdd3c5462d7852c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852c3b expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.090975:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7a00, rc 0) 00000100:00100000:2.0:1787378080.091027:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626569984:12345-0@lo:101: Request processed in 137us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.091034:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787378080.093003:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626569984:0@lo:101: 00010000:00010000:3.0:1787378080.093031:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.093043:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378080.093128:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570112:0@lo:501: 00000100:00100000:3.0:1787378080.093191:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378080.093231:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb91ada6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378080.093348:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626570112 00000100:00100000:2.0:1787378080.093355:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626570112 00000100:00100000:2.0:1787378080.093405:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787378080.093413:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626570112:12345-0@lo:501: 00000100:00100000:2.0:1787378080.093662:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626570112:12345-0@lo:501: Request processed in 249us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.093669:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787378080.094270:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570112:0@lo:501: 00000100:00100000:3.0:1787378080.094308:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570240:0@lo:503: 00000100:00100000:3.0:1787378080.094361:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378080.094396:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb91ada6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.094568:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626570240 00000100:00100000:1.0:1787378080.094573:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626570240 00000100:00100000:1.0:1787378080.094613:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787378080.094621:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626570240:12345-0@lo:503: 00000100:00100000:1.0:1787378080.094821:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626570240:12345-0@lo:503: Request processed in 200us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378080.094829:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787378080.095035:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570240:0@lo:503: 00000100:00100000:3.0:1787378080.100573:0:8309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8309:1874201626570368:0@lo:502: 00000100:00100000:3.0:1787378080.100674:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378080.100742:0:8309:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb91ada600 going to sleep for 11 seconds 00000100:00100000:0.0:1787378080.101083:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626570368 00000100:00100000:0.0:1787378080.101091:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626570368 00000100:00100000:0.0:1787378080.101145:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787378080.101155:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:8309:x1874201626570368:12345-0@lo:502: 00000100:00100000:0.0:1787378080.101426:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:8309:x1874201626570368:12345-0@lo:502: Request processed in 271us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378080.101434:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787378080.105215:0:8309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8309:1874201626570368:0@lo:502: 00000100:00100000:3.0:1787378080.105306:0:8309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8309:1874201626570496:0@lo:502: 00000100:00100000:3.0:1787378080.105390:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378080.105439:0:8309:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.105948:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626570496 00000100:00100000:1.0:1787378080.105957:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626570496 00000100:00100000:1.0:1787378080.106013:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787378080.106021:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:8309:x1874201626570496:12345-0@lo:502: 00000100:00100000:1.0:1787378080.106293:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:8309:x1874201626570496:12345-0@lo:502: Request processed in 271us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378080.106300:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787378080.106999:0:8309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8309:1874201626570496:0@lo:502: 00000040:00080000:3.0:1787378080.107031:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787378080.110026:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787378080.110070:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787378080.110082:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.110094:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378080.110103:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787378080.110121:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787378080.110124:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787378080.110174:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.110183:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.110194:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.110216:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570624:0@lo:101: 00000100:00100000:1.0:1787378080.110278:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378080.110493:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626570624 00000100:00100000:2.0:1787378080.110501:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626570624 00000100:00100000:2.0:1787378080.110556:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787378080.110564:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+13:5788:x1874201626570624:12345-0@lo:101: 00010000:00010000:2.0:1787378080.110576:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378080.110588:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c7400/0xdd3c5462d7852c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852c49 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.110608:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c7400/0xdd3c5462d7852c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852c49 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.110619:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c7400/0xdd3c5462d7852c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852c49 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.110637:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7400, rc 0) 00000100:00100000:2.0:1787378080.110670:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626570624:12345-0@lo:101: Request processed in 107us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.110676:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787378080.110989:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.111012:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570624:0@lo:101: 00010000:00010000:1.0:1787378080.111026:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.111035:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.111094:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570752:0@lo:501: 00000100:00100000:1.0:1787378080.111119:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378080.114213:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626570752 00000100:00100000:3.0:1787378080.114228:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626570752 00000100:00100000:3.0:1787378080.114286:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787378080.114297:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626570752:12345-0@lo:501: 00000100:00100000:3.0:1787378080.114604:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626570752:12345-0@lo:501: Request processed in 307us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.114613:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787378080.124117:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.124164:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570752:0@lo:501: 00000100:00100000:1.0:1787378080.124220:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570880:0@lo:503: 00000100:00100000:1.0:1787378080.124297:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.124417:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.132808:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626570880 00000100:00100000:3.0:1787378080.132823:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626570880 00000100:00100000:2.0:1787378080.142035:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787378080.142050:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626570880:12345-0@lo:503: 00000100:00100000:2.0:1787378080.148483:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626570880:12345-0@lo:503: Request processed in 6427us (24178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.148498:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787378080.150010:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626570880:0@lo:503: 00000100:00100000:1.0:1787378080.150689:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8310:1874201626571008:0@lo:502: 00000100:00100000:1.0:1787378080.150794:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.150837:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378080.151191:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626571008 00000100:00100000:2.0:1787378080.151200:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626571008 00000100:00100000:2.0:1787378080.151247:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787378080.151256:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:8310:x1874201626571008:12345-0@lo:502: 00000100:00100000:2.0:1787378080.151499:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:8310:x1874201626571008:12345-0@lo:502: Request processed in 243us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.151508:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787378080.152223:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8310:1874201626571008:0@lo:502: 00000020:01000000:3.0:1787378080.152257:0:8310:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787378080.152273:0:8310:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378080.152275:0:8310:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787378080.152281:0:8310:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787378080.152314:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8310:1874201626571136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378080.152357:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378080.152383:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787378080.153324:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626571136 00000100:00100000:2.0:1787378080.153332:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626571136 00000100:00100000:2.0:1787378080.153384:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787378080.153393:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:8310:x1874201626571136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378080.154780:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:8310:x1874201626571136:12345-0@lo:502:llog_process_th.0 Request processed in 1382us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.154792:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787378080.161340:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8310:1874201626571136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787378080.161415:0:8310:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378080.161425:0:8310:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378080.161427:0:8310:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787378080.161432:0:8310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787378080.163625:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787378080.163655:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787378080.163668:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.163681:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378080.163692:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787378080.163695:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eeb88344000 from 39 10000000:01000000:1.0:1787378080.163698:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787378080.163771:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.163780:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.163790:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.163814:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626571264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.163878:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.163917:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.164079:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626571264 00000100:00100000:3.0:1787378080.164086:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626571264 00000100:00100000:3.0:1787378080.164139:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787378080.164149:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:5788:x1874201626571264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378080.164162:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378080.164176:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852c5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852c57 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.164199:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852c57 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.164210:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852c57 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.164219:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04e00, rc 0) 00000100:00100000:3.0:1787378080.164259:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626571264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.164266:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787378080.164411:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626571264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378080.164425:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.164440:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.164503:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626571392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.164529:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.164558:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.164831:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626571392 00000100:00100000:3.0:1787378080.164836:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626571392 00000100:00100000:3.0:1787378080.164867:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787378080.164875:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626571392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378080.165132:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626571392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.165139:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787378080.165240:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626571392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.165269:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626571520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.165305:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.165333:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378080.165381:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626571520 00000100:00100000:2.0:1787378080.165386:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626571520 00000100:00100000:2.0:1787378080.165416:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787378080.165423:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626571520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378080.165582:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626571520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.165589:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787378080.165747:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626571520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.167096:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8311:1874201626571648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.167155:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.167194:0:8311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378080.167250:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626571648 00000100:00100000:2.0:1787378080.167256:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626571648 00000100:00100000:2.0:1787378080.167292:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787378080.167298:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:8311:x1874201626571648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378080.169712:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:8311:x1874201626571648:12345-0@lo:502:llog_process_th.0 Request processed in 2406us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.169741:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787378080.170164:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8311:1874201626571648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.170231:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8311:1874201626571776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.170276:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.170311:0:8311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.170907:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626571776 00000100:00100000:3.0:1787378080.170915:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626571776 00000100:00100000:3.0:1787378080.170965:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787378080.170973:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:8311:x1874201626571776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378080.171241:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:8311:x1874201626571776:12345-0@lo:502:llog_process_th.0 Request processed in 267us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.171249:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787378080.171566:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8311:1874201626571776:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787378080.171593:0:8311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787378080.171795:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787378080.171817:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787378080.171828:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.171868:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378080.171877:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787378080.171880:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787378080.171883:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787378080.171913:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.171922:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.171931:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.171949:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626571904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.171984:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.172018:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378080.172550:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626571904 00000100:00100000:2.0:1787378080.172556:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626571904 00000100:00100000:2.0:1787378080.172594:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787378080.172602:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:5788:x1874201626571904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378080.172619:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378080.172633:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c7e00/0xdd3c5462d7852c6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852c65 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.172654:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c7e00/0xdd3c5462d7852c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852c65 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.172663:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c7e00/0xdd3c5462d7852c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852c65 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378080.172671:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7e00, rc 0) 00000100:00100000:2.0:1787378080.173543:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626571904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.173556:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787378080.173662:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626571904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378080.173680:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.173691:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.173788:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.173829:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.173884:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378080.174565:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626572032 00000100:00100000:2.0:1787378080.174571:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626572032 00000100:00100000:2.0:1787378080.174607:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787378080.174614:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626572032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378080.175266:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626572032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 650us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378080.175274:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787378080.175958:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.176006:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.176050:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.176094:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.176150:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626572160 00000100:00100000:3.0:1787378080.176155:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626572160 00000100:00100000:3.0:1787378080.176194:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787378080.176201:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626572160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378080.176352:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626572160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.176359:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787378080.176446:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787378080.176984:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8312:1874201626572288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378080.177024:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378080.177053:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.177114:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626572288 00000100:00100000:3.0:1787378080.177119:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626572288 00000100:00100000:3.0:1787378080.177150:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787378080.177157:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:8312:x1874201626572288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378080.177311:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:8312:x1874201626572288:12345-0@lo:502:llog_process_th.0 Request processed in 153us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.177324:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787378080.177402:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8312:1874201626572288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787378080.177426:0:8312:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378080.177435:0:8312:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378080.177437:0:8312:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787378080.177442:0:8312:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787378080.177475:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8312:1874201626572416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.177507:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.177529:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.177749:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626572416 00000100:00100000:3.0:1787378080.177754:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626572416 00000100:00100000:3.0:1787378080.177785:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787378080.177791:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:8312:x1874201626572416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378080.177922:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:8312:x1874201626572416:12345-0@lo:502:llog_process_th.0 Request processed in 130us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.177929:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787378080.178300:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8312:1874201626572416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787378080.178320:0:8312:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378080.178324:0:8312:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378080.178326:0:8312:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787378080.178330:0:8312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787378080.178544:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787378080.178564:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787378080.178574:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378080.178585:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378080.178607:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787378080.178610:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eeb8a31b800 from 39 10000000:01000000:0.0:1787378080.178612:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787378080.178638:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378080.178647:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378080.178655:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378080.178670:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787378080.178703:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378080.178762:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.178978:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626572544 00000100:00100000:3.0:1787378080.178983:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626572544 00000100:00100000:3.0:1787378080.179023:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787378080.179030:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626572544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378080.179039:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378080.179051:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd05200/0xdd3c5462d7852c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852c73 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.179085:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd05200/0xdd3c5462d7852c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852c73 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.179096:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd05200/0xdd3c5462d7852c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852c73 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.179105:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05200, rc 0) 00000100:00100000:3.0:1787378080.179145:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626572544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.179151:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787378080.179216:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378080.179228:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.179236:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.179280:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.179317:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.179345:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.179393:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626572672 00000100:00100000:3.0:1787378080.179403:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626572672 00000100:00100000:3.0:1787378080.179435:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787378080.179442:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626572672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378080.179679:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626572672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.179686:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787378080.179873:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378080.179905:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378080.179941:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378080.179967:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84565780 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.180119:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626572800 00000100:00100000:3.0:1787378080.180123:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626572800 00000100:00100000:3.0:1787378080.180150:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787378080.180156:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626572800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378080.180292:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626572800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.180298:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787378080.180552:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626572800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.183336:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8313:1874201626572928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.183415:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.183471:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.183608:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626572928 00000100:00100000:3.0:1787378080.183615:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626572928 00000100:00100000:3.0:1787378080.183663:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787378080.183672:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:8313:x1874201626572928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378080.183950:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:8313:x1874201626572928:12345-0@lo:502:llog_process_th.0 Request processed in 279us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.183959:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787378080.184154:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8313:1874201626572928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378080.184201:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8313:1874201626573056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378080.184237:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378080.184269:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.184572:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626573056 00000100:00100000:1.0:1787378080.184577:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626573056 00000100:00100000:1.0:1787378080.184609:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787378080.184616:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:8313:x1874201626573056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.184787:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:8313:x1874201626573056:12345-0@lo:502:llog_process_th.0 Request processed in 171us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378080.184794:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787378080.185008:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8313:1874201626573056:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787378080.185030:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787378080.185945:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787378080.185966:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787378080.185976:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.185988:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378080.185998:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787378080.186000:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787378080.186003:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787378080.186031:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.186038:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.186077:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.186097:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.186138:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.186166:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787378080.186235:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626573184 00000100:00100000:3.0:1787378080.186241:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626573184 00000100:00100000:3.0:1787378080.186282:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787378080.186290:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626573184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378080.186300:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378080.186313:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04a00/0xdd3c5462d7852c88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852c81 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.186348:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04a00/0xdd3c5462d7852c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852c81 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.186358:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd04a00/0xdd3c5462d7852c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852c81 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378080.186367:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04a00, rc 0) 00000100:00100000:3.0:1787378080.186401:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626573184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378080.186408:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787378080.186488:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378080.186501:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.186510:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.186550:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.186573:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.186592:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.186606:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626573312 00000100:00100000:1.0:1787378080.186609:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626573312 00000100:00100000:1.0:1787378080.186625:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787378080.186632:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626573312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.186887:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626573312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378080.186895:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787378080.186922:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.186947:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.186986:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.187000:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.187011:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626573440 00000100:00100000:1.0:1787378080.187014:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626573440 00000100:00100000:1.0:1787378080.187030:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787378080.187036:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626573440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.187193:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626573440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378080.187200:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787378080.187234:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.187397:0:8314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8314:1874201626573568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.187432:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.187450:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626573568 00000100:00100000:1.0:1787378080.187453:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626573568 00000100:00100000:1.0:1787378080.187471:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787378080.187476:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:8314:x1874201626573568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.187618:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:8314:x1874201626573568:12345-0@lo:502:llog_process_th.0 Request processed in 140us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378080.187624:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787378080.187650:0:8314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.187663:0:8314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8314:1874201626573568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787378080.187681:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378080.187689:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378080.187691:0:8314:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787378080.187697:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787378080.187715:0:8314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8314:1874201626573696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.187772:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.187788:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626573696 00000100:00100000:1.0:1787378080.187791:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626573696 00000100:00100000:1.0:1787378080.187804:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787378080.187809:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:8314:x1874201626573696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378080.187915:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:8314:x1874201626573696:12345-0@lo:502:llog_process_th.0 Request processed in 105us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378080.187922:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787378080.187947:0:8314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.187958:0:8314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8314:1874201626573696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787378080.187974:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378080.187978:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378080.187980:0:8314:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787378080.187983:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787378080.188016:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787378080.188028:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787378080.188034:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.188042:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378080.188049:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787378080.188051:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9eeb882799c0 from 1 10000000:01000000:1.0:1787378080.188054:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787378080.188083:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.188090:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.188104:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.188117:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.188142:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.188154:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.188164:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626573824 00000100:00100000:1.0:1787378080.188167:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626573824 00000100:00100000:1.0:1787378080.188183:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787378080.188189:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626573824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378080.188196:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378080.188206:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81484c00/0xdd3c5462d7852c96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852c8f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.188223:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81484c00/0xdd3c5462d7852c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852c8f expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.188232:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81484c00/0xdd3c5462d7852c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852c8f expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.188240:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81484c00, rc 0) 00000100:00100000:1.0:1787378080.188267:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626573824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378080.188273:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787378080.188299:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378080.188309:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c96 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.188323:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c96 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.188359:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.188381:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378080.188393:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787378080.188402:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626573952 00000100:00100000:1.0:1787378080.188405:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626573952 00000100:00100000:1.0:1787378080.188420:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787378080.188425:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626573952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378080.188573:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626573952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (191us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787378080.188580:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787378080.188602:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626573952:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787378080.188617:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787378080.188621:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c96 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378080.188628:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c96 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378080.281972:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626574080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378080.282054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378080.282363:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626574080 00000100:00100000:0.0:1787378080.282370:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626574080 00000100:00100000:0.0:1787378080.282429:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787378080.282439:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626574080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378080.282484:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378080.282598:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626574080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378080.282606:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787378080.287469:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787378080.287492:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626574208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378080.287558:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378080.287615:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626574208 00000100:00100000:0.0:1787378080.287622:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626574208 00000100:00100000:0.0:1787378080.287669:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787378080.287678:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626574208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378080.287711:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378080.287780:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626574208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378080.287787:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787378080.287827:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c4e00 x1874201626574208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378080.287844:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626574208:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787378080.290415:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c4380 x1874201626574080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378080.290440:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626574080:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378080.730395:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378081.753918:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378082.779587:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378083.450160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378083.450801:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604526976 00000100:00100000:1.0:1787378083.450812:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604526976 00000100:00100000:1.0:1787378083.450867:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:1.0:1787378083.450877:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+8:5570:x1874201604526976:12345-192.168.203.22@tcp:101: 00010000:00010000:1.0:1787378083.450893:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378083.450911:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81484800/0xdd3c5462d7852c9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d4e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378083.450938:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81484800/0xdd3c5462d7852c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d4e expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378083.450949:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81484800/0xdd3c5462d7852c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d4e expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378083.450958:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81484800, rc 0) 00000100:00100000:1.0:1787378083.451023:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+9:5570:x1874201604526976:12345-192.168.203.22@tcp:101: Request processed in 147us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378083.451030:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:2.0:1787378083.453608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378083.453712:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604527104 00000100:00100000:0.0:1787378083.453757:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604527104 00000100:00100000:0.0:1787378083.453813:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:0.0:1787378083.453822:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+9:5570:x1874201604527104:12345-192.168.203.22@tcp:501: 00000100:00100000:0.0:1787378083.454751:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+9:5570:x1874201604527104:12345-192.168.203.22@tcp:501: Request processed in 895us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378083.454762:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:0.0:1787378083.475848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378083.475980:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604527232 00000100:00100000:3.0:1787378083.475993:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604527232 00000100:00100000:3.0:1787378083.476074:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:3.0:1787378083.476086:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+9:5570:x1874201604527232:12345-192.168.203.22@tcp:503: 00000100:00100000:3.0:1787378083.476395:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+9:5570:x1874201604527232:12345-192.168.203.22@tcp:503: Request processed in 309us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378083.476405:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:3.0:1787378083.480297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378083.480408:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604527360 00000100:00100000:0.0:1787378083.480437:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604527360 00000100:00100000:0.0:1787378083.480501:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:0.0:1787378083.480513:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+9:6061:x1874201604527360:12345-192.168.203.22@tcp:502: 00000100:00100000:0.0:1787378083.481118:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+9:6061:x1874201604527360:12345-192.168.203.22@tcp:502: Request processed in 604us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378083.481127:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:2.0:1787378083.486495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378083.486749:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604527488 00000100:00100000:1.0:1787378083.486761:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604527488 00000100:00100000:1.0:1787378083.486834:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:1.0:1787378083.486845:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+9:6061:x1874201604527488:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787378083.487584:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+9:6061:x1874201604527488:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 737us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378083.487595:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:1.0:1787378083.492018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378083.492177:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604527616 00000100:00100000:0.0:1787378083.492190:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604527616 00000100:00100000:0.0:1787378083.492258:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:0.0:1787378083.492269:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+9:5570:x1874201604527616:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787378083.492303:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378083.492332:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d7852ca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d55 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378083.492369:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d7852ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d55 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378083.492384:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d7852ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d55 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378083.492398:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b800, rc 0) 00000100:00100000:0.0:1787378083.492475:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:5570:x1874201604527616:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 207us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378083.492483:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:3.0:1787378083.501816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378083.502118:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604527744 00000100:00100000:1.0:1787378083.502156:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604527744 00000100:00100000:1.0:1787378083.502229:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:1.0:1787378083.502241:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:5570:x1874201604527744:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378083.504133:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:5570:x1874201604527744:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 1882us (2320us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787378083.504149:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 169 00010000:00010000:1.0:1787378083.801957:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378084.826799:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378084.892770:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626574592:0@lo:400:kworker.0 00000100:00100000:2.0:1787378084.892814:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626574720:0@lo:400:kworker.0 00000100:00100000:3.0:1787378084.892848:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378084.892867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378084.892929:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787378084.892937:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626574336:0@lo:400:kworker.0 00000100:00100000:2.0:1787378084.892970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378084.893005:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626574848:0@lo:400:kworker.0 00000100:00100000:2.0:1787378084.893040:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378084.893070:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626574592 00000100:00100000:2.0:1787378084.893076:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626574592 00000100:00100000:2.0:1787378084.893118:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626574848 00000100:00100000:2.0:1787378084.893121:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626574848 00000100:00100000:2.0:1787378084.893136:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787378084.893143:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626574592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378084.893187:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626574592:12345-0@lo:400:kworker.0 Request processed in 44us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378084.893193:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787378084.893206:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787378084.893212:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626574848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378084.893236:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626574464:0@lo:400:kworker.0 00000100:00100000:2.0:1787378084.893244:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626574848:12345-0@lo:400:kworker.0 Request processed in 31us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378084.893251:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787378084.893272:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626574720 00000100:00100000:1.0:1787378084.893276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378084.893278:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626574720 00000100:00100000:1.0:1787378084.893302:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626574976:0@lo:400:kworker.0 00000100:00100000:2.0:1787378084.893314:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787378084.893326:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378084.893333:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626574720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378084.893397:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626574336 00000100:00100000:0.0:1787378084.893401:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626574336 00000100:00100000:0.0:1787378084.893424:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787378084.893433:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626574336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378084.897658:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626574592:0@lo:400:kworker.0 00000100:00100000:3.0:1787378084.898195:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626574464 00000100:00100000:3.0:1787378084.898203:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626574464 00000100:00100000:3.0:1787378084.898247:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787378084.898255:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626574464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378084.898383:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626574976 00000100:00100000:1.0:1787378084.898389:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626574976 00000100:00100000:1.0:1787378084.898425:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787378084.898432:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626574976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378084.898486:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626574976:12345-0@lo:400:kworker.0 Request processed in 54us (5160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378084.898493:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787378084.898917:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50dc700 x1874201626574976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378084.898930:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626574976:0@lo:400:kworker.0 00000100:00100000:1.0:1787378084.899016:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626574848:0@lo:400:kworker.0 00000100:00080000:1.0:1787378084.899059:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378084.899064:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787378084.899081:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378084.906377:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626574336:12345-0@lo:400:kworker.0 Request processed in 12934us (13397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378084.906456:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787378084.906628:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626574336:0@lo:400:kworker.0 00000100:00100000:2.0:1787378084.908930:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626574720:12345-0@lo:400:kworker.0 Request processed in 15593us (16055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378084.908944:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787378084.909080:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50ded80 x1874201626574720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378084.909096:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626574720:0@lo:400:kworker.0 00000100:00100000:3.0:1787378084.910799:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626574464:12345-0@lo:400:kworker.0 Request processed in 12536us (17517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378084.910811:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787378084.911179:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626574464:0@lo:400:kworker.0 00000100:00100000:0.0:1787378084.989792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378084.989840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378084.989871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378084.989896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378084.989925:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604528000 00000100:00100000:0.0:1787378084.989934:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604528000 00000100:00100000:1.0:1787378084.990160:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604527872 00000100:00100000:1.0:1787378084.990165:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604527872 00000100:00100000:1.0:1787378084.990197:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:1.0:1787378084.990207:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:2353:x1874201604527872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378084.990297:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:2353:x1874201604527872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 89us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378084.990306:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:0.0:1787378084.990427:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1787378084.990437:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604528000:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378084.990473:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604528000:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378084.990480:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1787378084.990516:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604528128 00000100:00100000:0.0:1787378084.990520:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604528128 00000100:00100000:0.0:1787378084.990552:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604528256 00000100:00100000:0.0:1787378084.990555:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604528256 00000100:00100000:0.0:1787378084.990575:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1787378084.990581:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604528128:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378084.990604:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604528128:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378084.990609:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1787378084.990620:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1787378084.990626:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604528256:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378084.990667:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604528256:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378084.990673:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00080000:0.0:1787378084.990689:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787378084.990693:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787378084.990696:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378085.401967:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378085.401993:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626575104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378085.402074:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378085.402136:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626575104 00000100:00100000:0.0:1787378085.402144:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626575104 00000100:00100000:0.0:1787378085.402193:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787378085.402203:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626575104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378085.402237:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378085.402297:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626575104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378085.402304:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787378085.402524:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c6680 x1874201626575104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378085.402541:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626575104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378085.410069:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787378085.410098:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626575232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378085.410176:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378085.417936:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626575232 00000100:00100000:0.0:1787378085.417949:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626575232 00000100:00100000:0.0:1787378085.418042:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787378085.418052:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626575232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378085.418089:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378085.418172:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626575232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (7994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378085.418179:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787378085.418316:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c6680 x1874201626575232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378085.418336:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626575232:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1787378085.825227:0:8356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdbc50f8d0 00000020:00000080:1.0:1787378085.825243:0:8356:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787378085.825248:0:8356:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787378085.825256:0:8356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbc511b60 20000000:00000080:1.0:1787378085.825263:0:8356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eebae92f400 uarg=0000000000000000 20000000:01000000:1.0:1787378085.825314:0:8356:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787378085.825320:0:8356:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787378085.825324:0:8356:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787378085.827892:0:8357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787378085.828357:0:8356:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787378085.833535:0:8356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787378085.833592:0:8356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787378085.833644:0:8356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787378085.833664:0:8356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787378085.833684:0:8356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.833710:0:8356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81485400/0xdd3c5462d7852a20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.834166:0:8356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.834177:0:8356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.834189:0:8356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.834198:0:8356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.834378:0:8356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.834394:0:8356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 9 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378085.834421:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1874201626575360:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378085.834520:0:8356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.834529:0:8356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 18 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378085.834539:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1874201626575488:0@lo:104: 00000100:00100000:1.0:1787378085.834576:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787378085.834646:0:8356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.834655:0:8356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 18 pid: 5786 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378085.834663:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1874201626575616:0@lo:104: 00000100:00100000:1.0:1787378085.834687:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378085.838230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:1.0:1787378085.838818:0:8356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81485400/0xdd3c5462d7852a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.838834:0:8356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81485400/0xdd3c5462d7852a20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 18 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378085.838849:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1874201626575744:0@lo:104: 00000100:00100000:1.0:1787378085.838885:0:8356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787378085.838908:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1874201626575360:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378085.839125:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604528384 00000100:00100000:3.0:1787378085.839132:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604528384 00010000:00010000:3.0:1787378085.839177:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 10 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378085.839212:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1787378085.839222:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2354:x1874201604528384:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378085.839235:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378085.839241:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 10 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378085.839252:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 10 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378085.839584:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787378085.839613:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378085.839624:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626575488 00000100:00100000:1.0:1787378085.839628:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626575488 00000100:00100000:1.0:1787378085.839651:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626575616 00000100:00100000:1.0:1787378085.839654:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626575616 00000100:00100000:1.0:1787378085.839665:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626575744 00000100:00100000:1.0:1787378085.839668:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626575744 00000100:00100000:1.0:1787378085.839678:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787378085.839684:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:8356:x1874201626575488:12345-0@lo:104: 00010000:00010000:1.0:1787378085.839696:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.839780:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378085.839786:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:8356:x1874201626575488:12345-0@lo:104: Request processed in 102us (5210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378085.839792:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787378085.839824:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378085.839830:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.839837:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378085.839841:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.839849:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378085.839855:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378085.839861:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787378085.839895:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.839902:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378085.839924:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.839932:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a800/0xdd3c5462d7852b46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852b4d expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.839944:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378085.839946:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378085.839948:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378085.839962:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378085.839975:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626575872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378085.840005:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378085.840051:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787378085.840059:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:8356:x1874201626575616:12345-0@lo:104: 00010000:00010000:1.0:1787378085.840066:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840098:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378085.840103:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:8356:x1874201626575616:12345-0@lo:104: Request processed in 47us (5416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378085.840109:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787378085.840139:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378085.840144:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840151:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485c00 already unused, calling callback (ffffffffc1dbcc20) 00000100:00100000:0.0:1787378085.840240:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626575872 00000100:00100000:0.0:1787378085.840245:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626575872 00010000:00010000:0.0:1787378085.840265:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 19 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378085.840297:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787378085.840304:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626575872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378085.840314:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378085.840319:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 19 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378085.840344:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840351:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378085.840358:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378085.840363:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787378085.840383:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840390:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378085.840406:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840412:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7852a7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a82 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840422:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378085.840424:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378085.840426:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378085.840436:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626576000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378085.840461:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378085.840491:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787378085.840499:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1787378085.840591:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787378085.840598:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:8356:x1874201626575744:12345-0@lo:104: 00010000:00010000:1.0:1787378085.840605:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840642:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378085.840648:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:8356:x1874201626575744:12345-0@lo:104: Request processed in 51us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378085.840654:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787378085.840669:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378085.840673:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840681:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ae00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378085.840684:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840691:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378085.840697:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378085.840702:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787378085.840740:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840746:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378085.840755:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840761:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852a19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852a20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378085.840784:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378085.840786:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378085.840788:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378085.840797:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626576128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378085.840822:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787378085.841051:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852c0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d1d expref: 10 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.841105:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 19 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.841134:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378085.841408:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1787378085.841460:0:6603:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787378085.841469:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626576000 00000100:00100000:2.0:1787378085.841472:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626576000 00010000:00010000:2.0:1787378085.841490:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 20 pid: 5786 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378085.841503:0:6603:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787378085.841507:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626576128 00000100:00100000:2.0:1787378085.841509:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626576128 00010000:00010000:2.0:1787378085.841519:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81485400/0xdd3c5462d7852a20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 21 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378085.841528:0:6603:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787378085.841534:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787378085.841539:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+21:3313:x1874201626576000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378085.841559:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378085.841565:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 21 pid: 5786 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841573:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 21 pid: 5786 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841583:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378085.841611:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+21:3313:x1874201626576000:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378085.841617:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787378085.841629:0:6603:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787378085.841635:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787378085.841640:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3314:x1874201626576128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378085.841647:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378085.841651:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81485400/0xdd3c5462d7852a20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 20 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841659:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81485400/0xdd3c5462d7852a20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 20 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841670:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841677:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841690:0:6603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841708:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841714:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841743:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841750:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378085.841754:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841761:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841769:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378085.841779:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378085.841819:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3314:x1874201626576128:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378085.841825:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787378085.841979:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626575872:12345-0@lo:103:ldlm_bl.0 Request processed in 1675us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378085.841986:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787378085.842042:0:8356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852b4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852b46 expref: 18 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378085.842055:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1874201626575488:0@lo:104: 00010000:00010000:0.0:1787378085.842067:0:8356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c7200/0xdd3c5462d7852a82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852a7b expref: 17 pid: 5786 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378085.842075:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1874201626575616:0@lo:104: 00010000:00010000:0.0:1787378085.842083:0:8356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81485400/0xdd3c5462d7852a20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852a19 expref: 16 pid: 5783 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378085.842091:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1874201626575744:0@lo:104: 00010000:00010000:0.0:1787378085.842118:0:8356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.842127:0:8356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.842133:0:8356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378085.842139:0:8356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7852cab lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378085.842996:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626576128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378085.843039:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626576000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378085.843061:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626575872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787378085.843246:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378085.843681:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a49b169-b438-4a59-90b0-00ee704ad017+9:2354:x1874201604528384:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 4456us (5457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378085.843691:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00010000:00010000:1.0:1787378085.850934:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378086.873885:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378087.740192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378087.752579:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604528512 00000100:00100000:0.0:1787378087.752608:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604528512 00000100:00100000:0.0:1787378087.752715:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:0.0:1787378087.752761:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+9:5570:x1874201604528512:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787378087.752784:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378087.752804:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d5c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378087.752831:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378087.752842:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378087.752851:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a800, rc 0) 00000100:00100000:0.0:1787378087.752911:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:5570:x1874201604528512:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 152us (12727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.752919:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:2.0:1787378087.772464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378087.776556:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604528640 00000100:00100000:0.0:1787378087.776568:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604528640 00000100:00100000:0.0:1787378087.776627:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:0.0:1787378087.776637:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:5570:x1874201604528640:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378087.776929:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:5570:x1874201604528640:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 292us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.776938:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:2.0:1787378087.781389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378087.782949:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604528768 00000100:00100000:3.0:1787378087.782963:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604528768 00000100:00100000:3.0:1787378087.783033:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:3.0:1787378087.783043:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:5570:x1874201604528768:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378087.783255:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:5570:x1874201604528768:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 211us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378087.783263:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:3.0:1787378087.794646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378087.795287:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604528896 00000100:00100000:0.0:1787378087.795298:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604528896 00000100:00100000:0.0:1787378087.795359:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:0.0:1787378087.795369:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:6125:x1874201604528896:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787378087.795613:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:6125:x1874201604528896:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 245us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.795623:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:3.0:1787378087.800336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378087.800424:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604529024 00000100:00100000:0.0:1787378087.800434:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604529024 00000100:00100000:0.0:1787378087.800487:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:0.0:1787378087.800497:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:6125:x1874201604529024:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787378087.800757:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:6125:x1874201604529024:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 261us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.800767:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 176 10000000:01000000:1.0:1787378087.849848:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787378087.849856:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebbb181000 from 4 10000000:01000000:1.0:1787378087.849861:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787378087.849905:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.849917:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.849928:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378087.849953:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626576256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.850028:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378087.850083:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378087.850148:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626576256 00000100:00100000:3.0:1787378087.850155:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626576256 00000100:00100000:3.0:1787378087.850220:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787378087.850229:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626576256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378087.850243:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378087.850256:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852cb9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378087.850288:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378087.850315:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378087.850324:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04200, rc 0) 00000100:00100000:3.0:1787378087.850363:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626576256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378087.850369:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787378087.851058:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626576256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378087.851082:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.851092:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378087.851176:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626576384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.851208:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378087.851232:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378087.851284:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626576384 00000100:00100000:3.0:1787378087.851290:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626576384 00000100:00100000:3.0:1787378087.851325:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787378087.851331:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626576384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378087.851553:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626576384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378087.851561:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787378087.851907:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626576384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.851952:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626576512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.851990:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378087.852030:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378087.852309:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626576512 00000100:00100000:2.0:1787378087.852315:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626576512 00000100:00100000:2.0:1787378087.852357:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787378087.852366:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626576512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378087.852522:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626576512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378087.852530:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787378087.852626:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626576512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378087.854625:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8430:1874201626576640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378087.854694:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378087.854761:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378087.854857:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626576640 00000100:00100000:2.0:1787378087.854863:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626576640 00000100:00100000:2.0:1787378087.854914:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787378087.854981:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb87629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:8430:x1874201626576640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378087.855217:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb87629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:8430:x1874201626576640:12345-0@lo:502:llog_process_th.0 Request processed in 294us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.855225:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787378087.855706:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8430:1874201626576640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787378087.855881:0:8430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787378087.855891:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378087.855893:0:8430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787378087.855900:0:8430:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eebbb181000 00000020:00000080:3.0:1787378087.855902:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787378087.855973:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8430:1874201626576768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378087.856027:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378087.861858:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378087.866787:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626576768 00000100:00100000:1.0:1787378087.866813:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626576768 00000100:00100000:1.0:1787378087.866868:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787378087.866878:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:8430:x1874201626576768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378087.867173:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:8430:x1874201626576768:12345-0@lo:502:llog_process_th.0 Request processed in 283us (11132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378087.867181:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787378087.872094:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8430:1874201626576768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787378087.872569:0:8430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378087.872578:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378087.872581:0:8430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787378087.872649:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787378087.878907:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787378087.878942:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787378087.878954:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.878978:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378087.878988:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787378087.878990:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb88344000 from 4 10000000:01000000:1.0:1787378087.878993:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787378087.879041:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.879049:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.879065:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378087.879091:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626576896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.879167:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378087.879201:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626576896 00000100:00100000:1.0:1787378087.879207:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626576896 00000100:00100000:1.0:1787378087.879245:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787378087.879252:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb87628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626576896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378087.879275:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378087.879287:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852cc7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.879306:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.879315:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.879328:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547c00, rc 0) 00000100:00100000:1.0:1787378087.879368:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb87628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626576896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378087.879374:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787378087.879412:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787378087.879429:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626576896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378087.879442:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.879450:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378087.879487:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.879509:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378087.879524:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626577024 00000100:00100000:1.0:1787378087.879528:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626577024 00000100:00100000:1.0:1787378087.879546:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787378087.879551:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626577024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378087.884869:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787378087.895243:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626577024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 15681us (15723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378087.895258:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787378087.896406:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378087.896468:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378087.896528:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378087.896564:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378087.898508:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626577152 00000100:00100000:1.0:1787378087.898523:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626577152 00000100:00100000:1.0:1787378087.898577:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787378087.898587:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626577152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.898842:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626577152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378087.898850:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00010000:00010000:1.0:1787378087.898940:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378087.898967:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378087.907177:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8434:1874201626577280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378087.907252:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378087.907300:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787378087.908783:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626577280 00000100:00100000:0.0:1787378087.908796:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626577280 00000100:00100000:0.0:1787378087.908848:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787378087.908858:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:8434:x1874201626577280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378087.909107:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:8434:x1874201626577280:12345-0@lo:502:llog_process_th.0 Request processed in 250us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.909115:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787378087.909563:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8434:1874201626577280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378087.909600:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378087.909610:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378087.909612:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787378087.909620:0:8434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eeb88344000 00000020:00000080:2.0:1787378087.909625:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787378087.909700:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae710380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8434:1874201626577408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378087.909763:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378087.909789:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914300 going to sleep for 11 seconds 00000100:00100000:1.0:1787378087.911759:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626577408 00000100:00100000:1.0:1787378087.911772:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626577408 00000100:00100000:1.0:1787378087.911821:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787378087.911831:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:8434:x1874201626577408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378087.912088:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:8434:x1874201626577408:12345-0@lo:502:llog_process_th.0 Request processed in 257us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378087.912097:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787378087.912163:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae710380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8434:1874201626577408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787378087.912193:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378087.912201:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378087.912204:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787378087.912209:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787378087.912315:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787378087.912332:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787378087.912342:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.912353:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378087.912364:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787378087.912366:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb8a31b800 from 4 10000000:01000000:1.0:1787378087.912376:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787378087.912406:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.912415:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.912425:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378087.912444:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.912477:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378087.912498:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787378087.912511:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626577536 00000100:00100000:1.0:1787378087.912515:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626577536 00000100:00100000:1.0:1787378087.912539:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787378087.912547:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626577536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378087.912556:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378087.912569:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852cd5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.912590:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.912601:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.912610:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546000, rc 0) 00000100:00100000:1.0:1787378087.912638:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626577536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378087.912653:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787378087.912684:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378087.912696:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378087.912705:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378087.913109:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378087.913146:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378087.913182:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787378087.914460:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626577664 00000100:00100000:0.0:1787378087.914469:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626577664 00000100:00100000:0.0:1787378087.914520:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787378087.914537:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626577664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378087.914791:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626577664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.914799:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787378087.914842:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378087.914887:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787378087.914931:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378087.914949:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb88138240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378087.914962:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626577792 00000100:00100000:0.0:1787378087.914966:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626577792 00000100:00100000:0.0:1787378087.914991:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787378087.914998:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626577792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787378087.915142:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626577792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.915149:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787378087.915187:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626577792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787378087.919338:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8439:1874201626577920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378087.919418:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378087.919451:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626577920 00000100:00100000:0.0:1787378087.919457:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626577920 00000100:00100000:0.0:1787378087.919495:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787378087.919503:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:8439:x1874201626577920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378087.919699:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:8439:x1874201626577920:12345-0@lo:502:llog_process_th.0 Request processed in 195us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.919715:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787378087.919772:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb88138240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378087.919793:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8439:1874201626577920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787378087.919819:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378087.919827:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378087.919829:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787378087.919836:0:8439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eeb8a31b800 00000020:00000080:0.0:1787378087.919839:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787378087.920270:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8439:1874201626578048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378087.920305:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378087.920328:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626578048 00000100:00100000:0.0:1787378087.920333:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626578048 00000100:00100000:0.0:1787378087.920357:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787378087.920364:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:8439:x1874201626578048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378087.920478:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:8439:x1874201626578048:12345-0@lo:502:llog_process_th.0 Request processed in 113us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378087.920486:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787378087.920516:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb88138240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378087.920528:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:8439:1874201626578048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787378087.920546:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378087.920550:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378087.920552:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787378087.920556:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787378087.920614:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787378087.920635:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787378087.920645:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378087.920662:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378088.921897:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378089.946039:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378090.010114:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626578432:0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.010189:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378090.010481:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626578432 00000100:00100000:3.0:1787378090.010489:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626578432 00000100:00100000:3.0:1787378090.010549:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787378090.010559:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626578432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.010690:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626578432:12345-0@lo:400:kworker.0 Request processed in 131us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378090.010698:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787378090.010751:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378090.010906:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626578176:0@lo:400:kworker.0 00000100:00100000:2.0:1787378090.010944:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378090.010978:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378090.010984:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626578304:0@lo:400:kworker.0 00000100:00100000:2.0:1787378090.011019:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378090.011189:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626578304 00000100:00100000:2.0:1787378090.011193:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626578304 00000100:00100000:2.0:1787378090.011220:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787378090.011226:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626578304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.011379:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626578432:0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.011429:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626578560:0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.011473:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378090.011505:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626578560 00000100:00100000:3.0:1787378090.011509:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626578560 00000100:00100000:3.0:1787378090.011542:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787378090.011551:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626578560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.011598:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626578560:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378090.011605:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787378090.011623:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787378090.011642:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50dd500 x1874201626578560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378090.011653:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626578560:0@lo:400:kworker.0 00000100:00100000:2.0:1787378090.011869:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626578304:12345-0@lo:400:kworker.0 Request processed in 641us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378090.011877:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787378090.011904:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626578816:0@lo:400:kworker.0 00000100:00100000:2.0:1787378090.011929:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378090.011955:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787378090.011961:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874201626578688:0@lo:400:kworker.0 00000100:00100000:2.0:1787378090.011983:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378090.012018:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626578688 00000100:00100000:2.0:1787378090.012022:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626578688 00000100:00100000:2.0:1787378090.012051:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787378090.012057:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874201626578688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.015239:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626578816 00000100:00100000:3.0:1787378090.015266:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626578816 00000100:00100000:3.0:1787378090.015349:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787378090.015363:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626578816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378090.015516:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626578176 00000100:00100000:0.0:1787378090.015522:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626578176 00000100:00100000:0.0:1787378090.015553:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787378090.015559:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626578176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378090.015684:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874201626578688:12345-0@lo:400:kworker.0 Request processed in 3624us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378090.015693:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787378090.015769:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874201626578688:0@lo:400:kworker.0 00000100:00080000:2.0:1787378090.015808:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378090.015814:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378090.015834:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626578304:0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.019469:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626578816:12345-0@lo:400:kworker.0 Request processed in 4100us (7527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378090.019487:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787378090.020378:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae939500 x1874201626578816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378090.020395:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626578816:0@lo:400:kworker.0 00000100:00100000:0.0:1787378090.021418:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626578176:12345-0@lo:400:kworker.0 Request processed in 5853us (10467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378090.021432:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787378090.021553:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626578176:0@lo:400:kworker.0 00000100:00100000:3.0:1787378090.107819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378090.107871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378090.108161:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604529152 00000100:00100000:1.0:1787378090.108171:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604529152 00000100:00100000:1.0:1787378090.108223:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:1.0:1787378090.108233:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604529152:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378090.108308:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604529152:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 77us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378090.108317:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:3.0:1787378090.109893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378090.109922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378090.109949:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604529536 00000100:00100000:3.0:1787378090.109956:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604529536 00000100:00100000:3.0:1787378090.110028:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604529408 00000100:00100000:3.0:1787378090.110032:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604529408 00000100:00100000:3.0:1787378090.110055:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1787378090.110064:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604529536:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378090.110118:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604529536:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 55us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378090.110126:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1787378090.110142:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1787378090.110149:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604529408:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378090.110174:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604529408:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378090.110181:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00080000:3.0:1787378090.110198:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787378090.110202:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787378090.111877:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604529280 00000100:00100000:2.0:1787378090.111888:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604529280 00000100:00100000:2.0:1787378090.111945:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1787378090.111953:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604529280:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378090.112027:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604529280:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 74us (4155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378090.112034:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00080000:1.0:1787378090.112108:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378090.531094:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626578944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378090.531171:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378090.531338:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626578944 00000100:00100000:1.0:1787378090.531345:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626578944 00000100:00100000:1.0:1787378090.531404:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378090.531413:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626578944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378090.531447:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378090.531493:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626578944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378090.531499:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787378090.531540:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf635f80 x1874201626578944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378090.531559:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626578944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378090.534768:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378090.534791:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626579072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378090.534855:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378090.535264:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626579072 00000100:00100000:0.0:1787378090.535273:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626579072 00000100:00100000:0.0:1787378090.535328:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787378090.535338:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626579072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378090.535380:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378090.535434:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626579072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378090.535441:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787378090.535483:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c4380 x1874201626579072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378090.535501:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626579072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378090.980011:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378091.993911:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378093.018346:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787378093.542266:0:8657:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787378094.041980:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378095.065984:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378095.130133:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787378095.135090:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626579328:0@lo:400:kworker.0 00000100:00100000:1.0:1787378095.136861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378095.136972:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626579200:0@lo:400:kworker.0 00000100:00100000:1.0:1787378095.137021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378095.137152:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626579200 00000100:00100000:0.0:1787378095.137162:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626579200 00000100:00100000:0.0:1787378095.137222:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787378095.137231:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3312:x1874201626579200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.137318:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3312:x1874201626579200:12345-0@lo:400:kworker.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378095.137326:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787378095.137376:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626579200:0@lo:400:kworker.0 00000100:00100000:3.0:1787378095.137659:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626579328 00000100:00100000:3.0:1787378095.137665:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626579328 00000100:00100000:3.0:1787378095.137707:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787378095.137715:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626579328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378095.137786:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626579328:12345-0@lo:400:kworker.0 Request processed in 72us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378095.137792:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787378095.137988:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626579328:0@lo:400:kworker.0 00000100:00100000:2.0:1787378095.143083:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626579456:0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.143137:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626579840:0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.143200:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378095.143201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378095.143255:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787378095.143255:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787378095.143266:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626579584:0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.143268:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874201626579712:0@lo:400:kworker.0 00000100:00100000:2.0:1787378095.143307:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378095.143314:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378095.143354:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626579456 00000100:00100000:2.0:1787378095.143362:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626579456 00000100:00100000:0.0:1787378095.143382:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626579840 00000100:00100000:0.0:1787378095.143387:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626579840 00000100:00100000:2.0:1787378095.143424:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626579712 00000100:00100000:2.0:1787378095.143428:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626579712 00000100:00100000:0.0:1787378095.143441:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626579584 00000100:00100000:0.0:1787378095.143446:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626579584 00000100:00100000:0.0:1787378095.143475:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787378095.143486:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626579840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.143549:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626579840:12345-0@lo:400:kworker.0 Request processed in 65us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378095.143558:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787378095.143576:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787378095.143583:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626579584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.143617:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626579584:12345-0@lo:400:kworker.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378095.143623:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787378095.143664:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebade80700 x1874201626579840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378095.143688:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626579840:0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.143753:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787378095.143761:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626579456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.143796:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626579456:12345-0@lo:400:kworker.0 Request processed in 36us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378095.143802:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787378095.143858:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50dc700 x1874201626579584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378095.143870:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626579584:0@lo:400:kworker.0 00000100:00100000:0.0:1787378095.143886:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626579456:0@lo:400:kworker.0 00000100:00100000:2.0:1787378095.144194:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787378095.144204:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874201626579712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378095.144244:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874201626579712:12345-0@lo:400:kworker.0 Request processed in 43us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378095.144251:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787378095.144290:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874201626579712:0@lo:400:kworker.0 00000100:00080000:1.0:1787378095.145575:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787378095.145583:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378095.145587:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378095.232673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378095.232753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378095.235004:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604529792 00000100:00100000:1.0:1787378095.235024:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604529792 00000100:00100000:1.0:1787378095.235139:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1787378095.235151:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604529792:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378095.235270:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604529792:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 121us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378095.235278:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1787378095.236131:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604529664 00000100:00100000:3.0:1787378095.236140:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604529664 00000100:00100000:3.0:1787378095.236184:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:3.0:1787378095.236192:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604529664:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378095.236262:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604529664:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 70us (3604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378095.236280:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00080000:2.0:1787378095.237844:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378095.250796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378095.250848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378095.250890:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604529920 00000100:00100000:0.0:1787378095.250904:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604529920 00000100:00100000:0.0:1787378095.250988:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604530048 00000100:00100000:0.0:1787378095.250991:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604530048 00000100:00100000:0.0:1787378095.251024:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1787378095.251037:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2352:x1874201604529920:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:0.0:1787378095.251083:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852c18 00000100:00080000:0.0:1787378095.251094:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9eebad27d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787378095.251154:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787378095.251600:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1787378095.251612:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2352:x1874201604530048:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:3.0:1787378095.251635:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852c1f 00000100:00080000:3.0:1787378095.251642:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9eebad27c000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787378095.253661:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+2:2352:x1874201604529920:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 2606us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378095.253693:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00080000:0.0:1787378095.253758:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787378095.253764:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787378095.253826:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378095.258334:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787378095.265828:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787378095.270028:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+2:2352:x1874201604530048:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 18402us (19162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378095.270047:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1787378095.642033:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626579968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378095.642129:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378095.642235:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626579968 00000100:00100000:0.0:1787378095.642245:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626579968 00000100:00100000:0.0:1787378095.642303:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787378095.642313:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626579968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378095.642362:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378095.642415:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626579968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378095.642423:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787378095.642471:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf637480 x1874201626579968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378095.642491:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626579968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378095.643050:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626580096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378095.643094:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378095.643176:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626580096 00000100:00100000:1.0:1787378095.643182:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626580096 00000100:00100000:1.0:1787378095.643224:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787378095.643231:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626580096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378095.643260:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378095.643300:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626580096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378095.643306:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787378095.643417:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf634000 x1874201626580096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378095.643431:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626580096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378096.090302:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787378096.792646:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:3.0:1787378096.792661:0:6613:0:(genops.c:906:class_export_put()) final put ffff9eea821c4000/3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:2.0:1787378096.794759:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eea821c4000/3ca7eed4-13a1-4f52-9d12-97b20fe7905e for lustre-OST0000 00000020:00000080:2.0:1787378096.794832:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eebad27d800 for lustre-OST0000 00010000:00010000:0.0:1787378097.118644:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378098.137858:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787378098.318560:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:0.0:1787378098.318573:0:7491:0:(genops.c:906:class_export_put()) final put ffff9eebad27b800/3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:0.0:1787378098.321847:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebad27b800/3ca7eed4-13a1-4f52-9d12-97b20fe7905e for lustre-OST0001 00000020:00000080:0.0:1787378098.321998:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eebad27c000 for lustre-OST0001 00010000:00010000:1.0:1787378099.163107:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787378099.322282:0:8904:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing yml_node 00010000:00010000:1.0:1787378100.186636:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378100.255180:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626580224:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378100.255304:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626580736:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378100.255357:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787378100.255363:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626580352:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378100.255403:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626580864:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255426:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378100.255456:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626580608:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255479:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378100.255496:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787378100.255502:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626580480:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255521:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378100.255548:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626580224 00000100:00100000:2.0:1787378100.255555:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626580224 00000100:00100000:2.0:1787378100.255606:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787378100.255615:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626580224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255662:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626580224:12345-0@lo:400:kworker.0 Request processed in 49us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378100.255669:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787378100.255700:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626580736 00000100:00100000:2.0:1787378100.255704:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626580736 00000100:00100000:2.0:1787378100.255760:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626580352 00000100:00100000:2.0:1787378100.255764:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626580352 00000100:00100000:2.0:1787378100.255774:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626580480 00000100:00100000:2.0:1787378100.255776:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626580480 00000100:00100000:2.0:1787378100.255790:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787378100.255795:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626580736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255828:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626580736:12345-0@lo:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378100.255834:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787378100.255846:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787378100.255851:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626580352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255877:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626580352:12345-0@lo:400:kworker.0 Request processed in 27us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378100.255882:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787378100.255893:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787378100.255898:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626580480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.255939:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626580480:12345-0@lo:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378100.255945:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787378100.255989:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626580480:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.256016:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626580352:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.256024:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626580224:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.256032:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626580736:0@lo:400:kworker.0 00000100:00100000:0.0:1787378100.258948:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626580864 00000100:00100000:0.0:1787378100.258963:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626580864 00000100:00100000:0.0:1787378100.259036:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626580608 00000100:00100000:0.0:1787378100.259039:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626580608 00000100:00100000:0.0:1787378100.259153:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787378100.259164:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626580864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378100.259259:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626580864:12345-0@lo:400:kworker.0 Request processed in 98us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378100.259267:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787378100.259283:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787378100.259289:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626580608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378100.259322:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626580608:12345-0@lo:400:kworker.0 Request processed in 34us (3842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378100.259327:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787378100.261537:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787378100.261547:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378100.261550:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787378100.276549:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eeb9a239180 x1874201626580608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378100.276568:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626580608:0@lo:400:kworker.0 00010000:00080000:0.0:1787378100.276615:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eea830d1f80 x1874201626580864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378100.276626:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626580864:0@lo:400:kworker.0 00000100:00100000:2.0:1787378100.349251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378100.349623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378100.350586:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604530304 00000100:00100000:3.0:1787378100.350597:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604530304 00000100:00100000:3.0:1787378100.350671:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1787378100.350682:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604530304:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:2.0:1787378100.350809:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378100.351245:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604530304:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 562us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378100.351254:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1787378100.351649:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604530176 00000100:00100000:0.0:1787378100.351655:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604530176 00000100:00100000:0.0:1787378100.351736:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:0.0:1787378100.351745:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:2354:x1874201604530176:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378100.351784:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:2354:x1874201604530176:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 41us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378100.351790:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:0.0:1787378100.764854:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787378100.764878:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626580992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378100.764964:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378100.765022:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626580992 00000100:00100000:0.0:1787378100.765030:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626580992 00000100:00100000:0.0:1787378100.765073:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787378100.765081:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626580992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378100.765116:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378100.765159:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626580992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378100.765166:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787378100.765204:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c4a80 x1874201626580992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378100.765222:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626580992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378100.767398:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378100.772866:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626581120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378100.772955:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378100.773094:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626581120 00000100:00100000:0.0:1787378100.773103:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626581120 00000100:00100000:0.0:1787378100.773158:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787378100.773168:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626581120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378100.773204:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378100.773261:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626581120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378100.773268:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787378100.773378:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf634000 x1874201626581120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378100.773395:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626581120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378101.211039:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378102.233979:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378103.257877:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378104.283427:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787378104.362533:0:9096:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.117 00010000:00010000:1.0:1787378105.306679:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378105.375431:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626581632:0@lo:400:kworker.0 00000100:00100000:3.0:1787378105.375433:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626581376:0@lo:400:kworker.0 00000100:00100000:1.0:1787378105.375522:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378105.375532:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378105.375596:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787378105.375615:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626581248:0@lo:400:kworker.0 00000100:00100000:1.0:1787378105.375621:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626581504:0@lo:400:kworker.0 00000100:00100000:1.0:1787378105.379313:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378105.379452:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626581632 00000100:00100000:2.0:1787378105.379455:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626581376 00000100:00100000:1.0:1787378105.379466:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626581632 00000100:00100000:2.0:1787378105.379472:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626581376 00000100:00100000:2.0:1787378105.379561:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626581504 00000100:00100000:2.0:1787378105.379566:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626581504 00000100:00100000:1.0:1787378105.379571:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787378105.379587:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626581632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378105.379613:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787378105.379625:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626581376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378105.379702:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626581632:12345-0@lo:400:kworker.0 Request processed in 114us (4178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378105.379712:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787378105.379858:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf636a00 x1874201626581632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378105.379876:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626581632:0@lo:400:kworker.0 00000100:00100000:2.0:1787378105.380048:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626581376:12345-0@lo:400:kworker.0 Request processed in 97us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378105.380058:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787378105.380080:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787378105.380089:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626581504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378105.380247:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626581376:0@lo:400:kworker.0 00000100:00100000:3.0:1787378105.380264:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626581888:0@lo:400:kworker.0 00000100:00100000:3.0:1787378105.380332:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378105.381508:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626581504:12345-0@lo:400:kworker.0 Request processed in 1415us (5826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378105.381521:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787378105.381556:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378105.381562:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378105.381579:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626581888 00000100:00100000:2.0:1787378105.381586:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626581888 00000100:00100000:2.0:1787378105.381630:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787378105.381637:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626581888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378105.381685:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626581888:12345-0@lo:400:kworker.0 Request processed in 49us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378105.381692:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787378105.381862:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626581504:0@lo:400:kworker.0 00000100:00080000:2.0:1787378105.382330:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787378105.382372:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf637b80 x1874201626581888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378105.382389:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626581888:0@lo:400:kworker.0 00000100:00100000:0.0:1787378105.385407:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378105.385537:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626581760:0@lo:400:kworker.0 00000100:00100000:0.0:1787378105.385610:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378105.385673:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626581760 00000100:00100000:2.0:1787378105.385688:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626581760 00000100:00100000:2.0:1787378105.385780:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787378105.385789:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626581760:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787378105.385834:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378105.385909:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626581760:12345-0@lo:400:kworker.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378105.385919:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787378105.385938:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626581760:0@lo:400:kworker.0 00000100:00100000:1.0:1787378105.390968:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626581248 00000100:00100000:1.0:1787378105.390989:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626581248 00000100:00100000:1.0:1787378105.391072:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787378105.391084:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626581248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378105.391228:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626581248:12345-0@lo:400:kworker.0 Request processed in 146us (15543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378105.391236:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787378105.394949:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626581248:0@lo:400:kworker.0 00000100:00100000:3.0:1787378105.470304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378105.470351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378105.470385:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604530432 00000100:00100000:3.0:1787378105.470398:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604530432 00000100:00100000:3.0:1787378105.470461:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:3.0:1787378105.470472:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604530432:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378105.470560:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604530432:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378105.470569:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:3.0:1787378105.470608:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604530560 00000100:00100000:3.0:1787378105.470612:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604530560 00000100:00100000:3.0:1787378105.470665:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1787378105.470673:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604530560:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:0.0:1787378105.470870:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378105.475080:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604530560:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 4390us (4711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378105.475173:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1787378105.882505:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378105.882538:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626582016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378105.882631:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378105.883234:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626582144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378105.883275:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378105.883384:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626582016 00000100:00100000:1.0:1787378105.883395:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626582016 00000100:00100000:1.0:1787378105.883439:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626582144 00000100:00100000:1.0:1787378105.883459:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626582144 00000100:00100000:1.0:1787378105.883481:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787378105.883490:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626582016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378105.883537:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378105.883598:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626582016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378105.883606:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787378105.883625:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787378105.883632:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626582144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378105.883655:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378105.883681:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626582144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (405us total) trans 0 rc 0/0 00010000:00080000:2.0:1787378105.883682:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c6d80 x1874201626582016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378105.883687:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787378105.883703:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626582016:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787378105.883755:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf636a00 x1874201626582144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378105.883768:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626582144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378106.331124:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787378107.156513:0:9194:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.117 00010000:00010000:2.0:1787378107.353999:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378108.378855:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378109.401968:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787378110.354046:0:9292:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.117 00010000:00010000:2.0:1787378110.425951:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378110.496589:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626582528:0@lo:400:kworker.0 00000100:00100000:3.0:1787378110.496665:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378110.496749:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787378110.496756:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626582656:0@lo:400:kworker.0 00000100:00100000:3.0:1787378110.496783:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378110.496884:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626582272:0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.496920:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378110.496958:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626582784:0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.496983:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378110.497004:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787378110.497009:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626582400:0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497030:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378110.497047:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626582912:0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497067:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378110.497103:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626582528 00000100:00100000:2.0:1787378110.497110:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626582528 00000100:00100000:2.0:1787378110.497172:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626582784 00000100:00100000:2.0:1787378110.497176:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626582784 00000100:00100000:2.0:1787378110.497189:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626582400 00000100:00100000:2.0:1787378110.497191:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626582400 00000100:00100000:2.0:1787378110.497206:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787378110.497214:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626582528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497262:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626582528:12345-0@lo:400:kworker.0 Request processed in 48us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378110.497268:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787378110.497284:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787378110.497290:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626582784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497321:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626582784:12345-0@lo:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378110.497327:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787378110.497339:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787378110.497345:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626582400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497372:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626582400:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378110.497388:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787378110.497414:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626582656 00000100:00100000:2.0:1787378110.497418:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626582656 00000100:00100000:2.0:1787378110.497441:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626582912 00000100:00100000:2.0:1787378110.497444:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626582912 00000100:00100000:2.0:1787378110.497462:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787378110.497468:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626582656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497500:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626582656:12345-0@lo:400:kworker.0 Request processed in 32us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378110.497506:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787378110.497520:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787378110.497525:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626582912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497548:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626582912:12345-0@lo:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378110.497554:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787378110.497568:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378110.497571:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378110.497574:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378110.497605:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626582400:0@lo:400:kworker.0 00010000:00080000:2.0:1787378110.497616:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae939c00 x1874201626582912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378110.497624:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626582912:0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497632:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626582784:0@lo:400:kworker.0 00010000:00080000:2.0:1787378110.497660:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae93b100 x1874201626582656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378110.497684:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626582656:0@lo:400:kworker.0 00000100:00100000:2.0:1787378110.497697:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626582528:0@lo:400:kworker.0 00000100:00100000:3.0:1787378110.497867:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626582272 00000100:00100000:3.0:1787378110.497878:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626582272 00000100:00100000:3.0:1787378110.497916:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787378110.497922:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626582272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378110.497956:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626582272:12345-0@lo:400:kworker.0 Request processed in 34us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378110.497962:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787378110.498576:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626582272:0@lo:400:kworker.0 00000100:00100000:3.0:1787378110.585410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378110.585458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378110.586030:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604530688 00000100:00100000:0.0:1787378110.586043:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604530688 00000100:00100000:0.0:1787378110.586111:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:0.0:1787378110.586121:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2356:x1874201604530688:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378110.586198:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2356:x1874201604530688:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378110.586206:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:2.0:1787378110.587149:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604530816 00000100:00100000:2.0:1787378110.587160:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604530816 00000100:00100000:2.0:1787378110.587292:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1787378110.587301:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604530816:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378110.587359:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604530816:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 59us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378110.587365:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00080000:0.0:1787378110.588956:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378111.002098:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626583040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378111.002170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378111.002327:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626583040 00000100:00100000:0.0:1787378111.002335:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626583040 00000100:00100000:0.0:1787378111.002395:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787378111.002406:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626583040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378111.002442:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378111.002505:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626583040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378111.002512:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787378111.002542:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c7b80 x1874201626583040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378111.002570:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626583040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378111.002595:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787378111.002605:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626583168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378111.002673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378111.003036:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626583168 00000100:00100000:1.0:1787378111.003044:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626583168 00000100:00100000:1.0:1787378111.003099:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787378111.003109:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626583168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378111.003146:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378111.003202:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626583168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378111.003209:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787378111.003335:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf636a00 x1874201626583168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378111.003352:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626583168:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378111.451976:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787378112.088135:0:9340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 01:55:10 EDT 2026 00010000:00010000:2.0:1787378112.475546:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378113.499249:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378114.521842:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378115.546125:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378115.610158:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626583296:0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610234:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378115.610295:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626583808:0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610323:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378115.610349:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787378115.610354:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626583424:0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610374:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378115.610388:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626583936:0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610407:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378115.610430:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626583680:0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610448:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378115.610481:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787378115.610486:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626583552:0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378115.610528:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626583808 00000100:00100000:2.0:1787378115.610535:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626583808 00000100:00100000:2.0:1787378115.610587:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626583424 00000100:00100000:2.0:1787378115.610591:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626583424 00000100:00100000:2.0:1787378115.610604:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626583552 00000100:00100000:2.0:1787378115.610606:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626583552 00000100:00100000:2.0:1787378115.610619:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787378115.610626:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626583808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610686:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626583808:12345-0@lo:400:kworker.0 Request processed in 60us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378115.610694:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787378115.610709:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787378115.610714:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626583424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610769:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626583424:12345-0@lo:400:kworker.0 Request processed in 55us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378115.610774:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787378115.610786:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787378115.610792:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626583552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610832:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626583552:12345-0@lo:400:kworker.0 Request processed in 40us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378115.610838:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787378115.610859:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626583936 00000100:00100000:2.0:1787378115.610863:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626583936 00000100:00100000:2.0:1787378115.610888:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626583680 00000100:00100000:2.0:1787378115.610891:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626583680 00000100:00100000:2.0:1787378115.610928:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787378115.610934:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626583936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.610963:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626583936:12345-0@lo:400:kworker.0 Request processed in 30us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378115.610969:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787378115.610978:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787378115.610983:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626583680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.611004:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626583680:12345-0@lo:400:kworker.0 Request processed in 21us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378115.611009:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787378115.611025:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378115.611029:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378115.611032:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378115.611061:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626583552:0@lo:400:kworker.0 00010000:00080000:2.0:1787378115.611074:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf636d80 x1874201626583680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378115.611083:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626583680:0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.611111:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626583424:0@lo:400:kworker.0 00010000:00080000:2.0:1787378115.611120:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae989c00 x1874201626583936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378115.611127:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626583936:0@lo:400:kworker.0 00000100:00100000:2.0:1787378115.611135:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626583808:0@lo:400:kworker.0 00000100:00100000:1.0:1787378115.611357:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626583296 00000100:00100000:1.0:1787378115.611361:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626583296 00000100:00100000:1.0:1787378115.611402:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787378115.611408:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626583296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378115.611451:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626583296:12345-0@lo:400:kworker.0 Request processed in 43us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378115.611458:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787378115.611790:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626583296:0@lo:400:kworker.0 00000100:00100000:3.0:1787378115.710397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378115.710451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378115.710548:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604530944 00000100:00100000:1.0:1787378115.710558:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604530944 00000100:00100000:1.0:1787378115.710619:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:1.0:1787378115.710628:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:2354:x1874201604530944:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378115.710706:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:2354:x1874201604530944:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378115.710715:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:2.0:1787378115.711152:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604531072 00000100:00100000:2.0:1787378115.711157:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604531072 00000100:00100000:2.0:1787378115.711213:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1787378115.711221:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604531072:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378115.711261:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604531072:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 41us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378115.711268:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00080000:0.0:1787378115.712072:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378116.126653:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626584064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378116.126772:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378116.126916:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626584064 00000100:00100000:0.0:1787378116.126924:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626584064 00000100:00100000:0.0:1787378116.126983:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787378116.126992:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626584064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378116.127029:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378116.127090:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626584064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378116.127112:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787378116.127628:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c7b80 x1874201626584064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378116.127649:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626584064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378116.131948:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787378116.131971:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626584192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378116.132035:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378116.132278:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626584192 00000100:00100000:0.0:1787378116.132287:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626584192 00000100:00100000:0.0:1787378116.132334:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787378116.132344:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626584192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378116.132378:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378116.132418:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626584192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378116.132426:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787378116.132506:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae98b100 x1874201626584192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378116.132524:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626584192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787378116.570632:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378117.601343:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378118.623307:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378119.643071:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378120.669514:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378120.730352:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626584320:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.730424:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378120.730465:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626584832:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.730513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378120.730542:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787378120.730549:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626584448:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.730572:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378120.730589:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626584960:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.730611:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378120.730639:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626584576:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.730660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378120.730677:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787378120.730682:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626584704:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.730702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378120.730954:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626584320 00000100:00100000:0.0:1787378120.730962:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626584320 00000100:00100000:0.0:1787378120.731020:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787378120.731028:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626584320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731081:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626584320:12345-0@lo:400:kworker.0 Request processed in 52us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378120.731088:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787378120.731120:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626584832 00000100:00100000:0.0:1787378120.731124:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626584832 00000100:00100000:0.0:1787378120.731152:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626584448 00000100:00100000:0.0:1787378120.731155:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626584448 00000100:00100000:0.0:1787378120.731165:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626584576 00000100:00100000:0.0:1787378120.731167:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626584576 00000100:00100000:0.0:1787378120.731180:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787378120.731186:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626584832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731218:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626584832:12345-0@lo:400:kworker.0 Request processed in 32us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378120.731223:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787378120.731235:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787378120.731240:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626584448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731265:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626584448:12345-0@lo:400:kworker.0 Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378120.731272:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787378120.731283:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787378120.731289:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626584576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731319:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626584576:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378120.731325:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787378120.731344:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626584960 00000100:00100000:0.0:1787378120.731353:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626584960 00000100:00100000:0.0:1787378120.731380:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626584704 00000100:00100000:0.0:1787378120.731383:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626584704 00000100:00100000:0.0:1787378120.731402:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787378120.731408:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626584960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731437:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626584960:12345-0@lo:400:kworker.0 Request processed in 29us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378120.731442:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787378120.731453:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787378120.731459:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626584704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731483:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626584704:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378120.731489:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787378120.731510:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787378120.731513:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787378120.731516:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787378120.731546:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50dd180 x1874201626584704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378120.731559:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626584704:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731568:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626584576:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731596:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626584448:0@lo:400:kworker.0 00010000:00080000:0.0:1787378120.731606:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50dc700 x1874201626584960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378120.731614:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626584960:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731621:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626584320:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.731640:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626584832:0@lo:400:kworker.0 00000100:00100000:0.0:1787378120.836056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378120.836105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378120.836137:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604531328 00000100:00100000:0.0:1787378120.836145:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604531328 00000100:00100000:0.0:1787378120.836216:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:0.0:1787378120.836225:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604531328:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378120.836293:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604531328:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378120.836301:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00080000:0.0:1787378120.836414:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378120.836791:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604531200 00000100:00100000:2.0:1787378120.836796:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604531200 00000100:00100000:2.0:1787378120.836823:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:2.0:1787378120.836830:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604531200:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378120.836864:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604531200:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 34us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378120.836871:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:1.0:1787378121.248064:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378121.248086:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626585088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378121.248149:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378121.248221:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626585088 00000100:00100000:1.0:1787378121.248228:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626585088 00000100:00100000:1.0:1787378121.248274:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787378121.248282:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626585088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378121.248316:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378121.248374:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626585088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378121.248382:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787378121.248421:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae98b100 x1874201626585088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378121.248438:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626585088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378121.248955:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626585216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378121.248987:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378121.249024:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626585216 00000100:00100000:1.0:1787378121.249028:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626585216 00000100:00100000:1.0:1787378121.249204:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787378121.249212:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626585216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378121.249236:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378121.249271:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626585216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378121.249277:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787378121.249421:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae98b100 x1874201626585216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378121.249436:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626585216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787378121.694742:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378122.736580:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378123.742036:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378124.773045:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378125.786221:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378125.851624:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626585728:0@lo:400:kworker.0 00000100:00100000:3.0:1787378125.851796:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378125.851996:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787378125.852004:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626585600:0@lo:400:kworker.0 00000100:00100000:3.0:1787378125.852034:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378125.853004:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626585344:0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.853074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378125.853124:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626585856:0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.853149:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378125.853174:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787378125.853181:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626585472:0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.853202:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378125.853217:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626585984:0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.853239:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378125.853274:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626585728 00000100:00100000:0.0:1787378125.853283:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626585728 00000100:00100000:0.0:1787378125.853340:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626585984 00000100:00100000:0.0:1787378125.853343:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626585984 00000100:00100000:0.0:1787378125.853379:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787378125.853387:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626585728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.853444:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626585728:12345-0@lo:400:kworker.0 Request processed in 58us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378125.853452:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787378125.853470:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787378125.853476:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626585984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.853507:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626585984:12345-0@lo:400:kworker.0 Request processed in 31us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378125.853513:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787378125.853534:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787378125.853539:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378125.853549:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626585600 00000100:00100000:2.0:1787378125.853557:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626585600 00010000:00080000:0.0:1787378125.853579:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae939500 x1874201626585984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378125.853597:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626585984:0@lo:400:kworker.0 00000100:00100000:2.0:1787378125.853608:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626585856 00000100:00100000:2.0:1787378125.853613:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626585856 00000100:00080000:0.0:1787378125.853626:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378125.853643:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626585472 00000100:00100000:2.0:1787378125.853648:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626585472 00000100:00100000:2.0:1787378125.853666:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787378125.853673:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626585600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378125.854082:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626585600:12345-0@lo:400:kworker.0 Request processed in 408us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378125.854090:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787378125.854110:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787378125.854118:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626585856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378125.854155:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626585856:12345-0@lo:400:kworker.0 Request processed in 38us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378125.854162:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787378125.854174:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787378125.855101:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626585472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378125.855178:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626585472:12345-0@lo:400:kworker.0 Request processed in 996us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378125.855258:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787378125.856954:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626585344 00000100:00100000:3.0:1787378125.856970:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626585344 00000100:00100000:3.0:1787378125.857058:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787378125.857069:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626585344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378125.857154:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626585344:12345-0@lo:400:kworker.0 Request processed in 86us (4079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378125.857162:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787378125.857236:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626585600:0@lo:400:kworker.0 00010000:00080000:3.0:1787378125.857254:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae939c00 x1874201626585728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378125.857265:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626585728:0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.857482:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626585472:0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.857493:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626585344:0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.857507:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626585856:0@lo:400:kworker.0 00000100:00100000:0.0:1787378125.953935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378125.953994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378125.954543:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604531584 00000100:00100000:3.0:1787378125.954558:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604531584 00000100:00100000:3.0:1787378125.954664:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:3.0:1787378125.954677:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604531584:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378125.954833:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604531584:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 158us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378125.954841:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:2.0:1787378125.955629:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604531456 00000100:00100000:2.0:1787378125.955638:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604531456 00000100:00100000:2.0:1787378125.955685:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:2.0:1787378125.955694:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604531456:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378125.955801:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2355:x1874201604531456:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 107us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378125.955809:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00080000:0.0:1787378125.956540:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378126.363790:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626586240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378126.363895:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378126.364012:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787378126.364019:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626586112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378126.364051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378126.364249:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626586240 00000100:00100000:2.0:1787378126.364258:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626586240 00000100:00100000:2.0:1787378126.364312:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626586112 00000100:00100000:2.0:1787378126.364315:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626586112 00000100:00100000:2.0:1787378126.364333:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787378126.364343:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626586240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787378126.364389:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378126.364448:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626586240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378126.364457:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787378126.364479:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787378126.364486:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626586112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787378126.364507:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378126.364540:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626586112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378126.364546:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787378126.364798:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae98b100 x1874201626586112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378126.364818:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626586112:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787378126.364830:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eea830d1f80 x1874201626586240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378126.364841:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626586240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378126.810016:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787378127.702544:0:9970:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:55:26 (1787378126) === 00010000:00010000:0.0:1787378127.838657:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378128.168952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378128.169215:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604531712 00000100:00100000:2.0:1787378128.169229:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604531712 00000100:00100000:2.0:1787378128.169303:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:2.0:1787378128.169314:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+10:8120:x1874201604531712:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787378128.169337:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378128.169362:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852ce3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d63 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378128.169400:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d63 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378128.169425:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d63 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378128.169449:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6200, rc 0) 00000100:00100000:2.0:1787378128.169526:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+11:8120:x1874201604531712:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 213us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.169534:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:1.0:1787378128.185707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378128.186012:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604531840 00000100:00100000:3.0:1787378128.186027:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604531840 00000100:00100000:3.0:1787378128.186142:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1787378128.186154:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+11:8120:x1874201604531840:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787378128.186978:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+11:8120:x1874201604531840:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 820us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378128.187047:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:0.0:1787378128.192689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378128.192956:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604531968 00000100:00100000:2.0:1787378128.192970:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604531968 00000100:00100000:2.0:1787378128.193054:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:2.0:1787378128.193065:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+11:8120:x1874201604531968:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787378128.193355:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+11:8120:x1874201604531968:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 289us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.193363:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:0.0:1787378128.203573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378128.203777:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604532096 00000100:00100000:3.0:1787378128.203802:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604532096 00000100:00100000:3.0:1787378128.203875:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:3.0:1787378128.203888:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+11:8124:x1874201604532096:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787378128.204280:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+11:8124:x1874201604532096:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 393us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378128.204291:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:1.0:1787378128.246347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378128.246507:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604532224 00000100:00100000:3.0:1787378128.246520:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604532224 00000100:00100000:3.0:1787378128.247149:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:3.0:1787378128.247159:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+11:8124:x1874201604532224:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787378128.247517:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+11:8124:x1874201604532224:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 357us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378128.247527:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:0.0:1787378128.252446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378128.252573:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604532352 00000100:00100000:2.0:1787378128.252587:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604532352 00000100:00100000:2.0:1787378128.252668:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:2.0:1787378128.252681:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+11:8120:x1874201604532352:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787378128.252703:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378128.252757:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852cea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d8d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378128.252796:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d8d expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378128.252810:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d8d expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378128.252821:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6e00, rc 0) 00000100:00100000:2.0:1787378128.253058:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+12:8120:x1874201604532352:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 380us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.253066:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:0.0:1787378128.261377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378128.261600:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604532480 00000100:00100000:3.0:1787378128.261616:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604532480 00000100:00100000:3.0:1787378128.261697:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:3.0:1787378128.261709:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+12:8120:x1874201604532480:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787378128.261776:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787378128.261813:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787378128.261818:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787378128.261822:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787378128.261825:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787378128.273250:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+12:8120:x1874201604532480:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 11526us (11872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378128.273269:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:0.0:1787378128.280989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378128.283228:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604532608 00000100:00100000:3.0:1787378128.283248:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604532608 00000100:00100000:3.0:1787378128.283340:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:3.0:1787378128.283353:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+12:8120:x1874201604532608:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787378128.283377:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378128.283405:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6d94 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378128.283442:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378128.283480:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378128.283492:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05c00, rc 0) 00000100:00100000:3.0:1787378128.283593:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:8120:x1874201604532608:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 243us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378128.283600:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:0.0:1787378128.290023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378128.290214:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604532736 00000100:00100000:3.0:1787378128.290227:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604532736 00000100:00100000:3.0:1787378128.290304:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:3.0:1787378128.290316:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:8120:x1874201604532736:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787378128.290699:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:8120:x1874201604532736:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 383us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378128.290708:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:1.0:1787378128.296040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378128.296260:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604532864 00000100:00100000:2.0:1787378128.296276:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604532864 00000100:00100000:2.0:1787378128.296355:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:2.0:1787378128.296367:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:8120:x1874201604532864:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787378128.296683:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:8120:x1874201604532864:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 317us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.296693:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:0.0:1787378128.301503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378128.301670:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604532992 00000100:00100000:2.0:1787378128.301686:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604532992 00000100:00100000:2.0:1787378128.301835:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:2.0:1787378128.301848:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:8130:x1874201604532992:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787378128.304771:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:8130:x1874201604532992:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 2908us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.304798:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:1.0:1787378128.325494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378128.329546:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604533120 00000100:00100000:0.0:1787378128.329577:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604533120 00000100:00100000:0.0:1787378128.329668:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:0.0:1787378128.329680:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:8130:x1874201604533120:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787378128.330431:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:8130:x1874201604533120:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 748us (4947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378128.330443:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:1.0:1787378128.337136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378128.337206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378128.337487:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604533632 00000100:00100000:3.0:1787378128.337499:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604533632 00000100:00100000:3.0:1787378128.337577:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604533248 00000100:00100000:3.0:1787378128.337581:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604533248 00000100:00100000:3.0:1787378128.337598:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1787378128.337610:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604533632:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378128.337714:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604533632:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 105us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.337938:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787378128.337952:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787378128.338101:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787378128.338108:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1874201604533248:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787378128.338149:0:5791:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 1984c41f-3b43-4d7f-8b57-f1444ac920d9@192.168.203.22@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1787378128.338210:0:5791:0:(genops.c:1406:class_connect()) connect: client 1984c41f-3b43-4d7f-8b57-f1444ac920d9, cookie 0xdd3c5462d7852cf8 00000004:00100000:2.0:1787378128.338251:0:5791:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787378128.338598:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9eeb8835c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378128.338660:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2352:x1874201604533248:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 550us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.338669:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1787378128.339257:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00080000:0.0:1787378128.339706:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378128.351371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378128.351427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378128.351505:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604533376 00000100:00100000:2.0:1787378128.351528:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604533376 00000100:00100000:2.0:1787378128.351623:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604533504 00000100:00100000:2.0:1787378128.351626:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604533504 00000100:00100000:2.0:1787378128.351650:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787378128.351663:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+7:0:x1874201604533376:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787378128.351760:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787378128.351903:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+7:0:x1874201604533376:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 242us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.351912:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787378128.351936:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1787378128.351943:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:8120:x1874201604533504:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787378128.351956:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787378128.351979:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:8120:x1874201604533504:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 36us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.351986:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00080000:1.0:1787378128.352243:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378128.354464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378128.355750:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604533760 00000100:00100000:2.0:1787378128.355767:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604533760 00000100:00100000:2.0:1787378128.356217:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:2.0:1787378128.356230:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:8120:x1874201604533760:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787378128.356399:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:8120:x1874201604533760:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 170us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378128.356408:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1787378128.378354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378128.378408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378128.378442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378128.378544:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604533888 00000100:00100000:0.0:1787378128.378567:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604533888 00000100:00100000:0.0:1787378128.378622:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604534016 00000100:00100000:0.0:1787378128.378626:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604534016 00000100:00100000:0.0:1787378128.378652:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787378128.378661:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874201604533888:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787378128.378705:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 1984c41f-3b43-4d7f-8b57-f1444ac920d9@192.168.203.22@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1787378128.378799:0:6586:0:(genops.c:1406:class_connect()) connect: client 1984c41f-3b43-4d7f-8b57-f1444ac920d9, cookie 0xdd3c5462d7852cff 00002000:00100000:0.0:1787378128.378817:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1984c41f-3b43-4d7f-8b57-f1444ac920d9/ffff9eeb87618800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787378128.378848:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787378128.379156:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787378128.379227:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eeb8761c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378128.379328:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2352:x1874201604533888:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 666us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378128.379339:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787378128.379369:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1787378128.379376:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874201604534016:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787378128.379401:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 1984c41f-3b43-4d7f-8b57-f1444ac920d9@192.168.203.22@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1787378128.379423:0:6586:0:(genops.c:1406:class_connect()) connect: client 1984c41f-3b43-4d7f-8b57-f1444ac920d9, cookie 0xdd3c5462d7852d06 00002000:00100000:0.0:1787378128.379431:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1984c41f-3b43-4d7f-8b57-f1444ac920d9/ffff9eeb8761b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787378128.379451:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787378128.379592:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787378128.379612:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eeb8761f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378128.379637:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2352:x1874201604534016:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 261us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378128.379645:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1787378128.380278:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604534144 00000100:00100000:3.0:1787378128.380289:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604534144 00000100:00100000:3.0:1787378128.380354:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:3.0:1787378128.380363:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:8120:x1874201604534144:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787378128.380689:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787378128.380903:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:8120:x1874201604534144:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 540us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378128.380912:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00010000:00010000:0.0:1787378128.858100:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787378128.998509:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1984c41f-3b43-4d7f-8b57-f1444ac920d9 00010000:00010000:0.0:1787378129.885306:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787378129.998842:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1984c41f-3b43-4d7f-8b57-f1444ac920d9 00010000:00010000:2.0:1787378130.907069:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378130.975379:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626586368:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.975452:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378130.975501:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626586880:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.975528:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378130.975556:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787378130.975562:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626586496:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.975583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378130.975599:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626587008:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.975623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378130.975652:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626586624:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.975673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378130.975691:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378130.975696:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626586752:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.975749:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378130.975781:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626586368 00000100:00100000:2.0:1787378130.975788:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626586368 00000100:00100000:2.0:1787378130.975841:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787378130.975851:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626586368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.975901:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626586368:12345-0@lo:400:kworker.0 Request processed in 51us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378130.975908:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787378130.975954:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626586880 00000100:00100000:2.0:1787378130.975957:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626586880 00000100:00100000:2.0:1787378130.975992:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626586496 00000100:00100000:2.0:1787378130.976001:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626586496 00000100:00100000:2.0:1787378130.976015:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626586624 00000100:00100000:2.0:1787378130.976018:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626586624 00000100:00100000:2.0:1787378130.976032:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787378130.976038:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626586880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976071:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626586880:12345-0@lo:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378130.976076:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787378130.976088:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787378130.976093:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626586496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976117:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626586496:12345-0@lo:400:kworker.0 Request processed in 24us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378130.976122:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787378130.976132:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787378130.976138:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626586624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976169:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626586624:12345-0@lo:400:kworker.0 Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378130.976175:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787378130.976196:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626587008 00000100:00100000:2.0:1787378130.976199:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626587008 00000100:00100000:2.0:1787378130.976223:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626586752 00000100:00100000:2.0:1787378130.976225:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626586752 00000100:00100000:2.0:1787378130.976243:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787378130.976249:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626587008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976278:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626587008:12345-0@lo:400:kworker.0 Request processed in 29us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378130.976283:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787378130.976301:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787378130.976307:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626586752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976335:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626586752:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378130.976341:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787378130.976365:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378130.976369:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378130.976371:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787378130.976404:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf635c00 x1874201626586752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378130.976416:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626586752:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976428:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626586624:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976456:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626586496:0@lo:400:kworker.0 00010000:00080000:2.0:1787378130.976466:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf637b80 x1874201626587008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378130.976475:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626587008:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976482:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626586368:0@lo:400:kworker.0 00000100:00100000:2.0:1787378130.976492:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626586880:0@lo:400:kworker.0 00000100:00100000:3.0:1787378131.483180:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626587136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378131.483246:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378131.483319:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626587136 00000100:00100000:3.0:1787378131.483326:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626587136 00000100:00100000:3.0:1787378131.483371:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787378131.483380:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626587136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378131.483412:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378131.483455:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626587136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378131.483462:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787378131.483501:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae704000 x1874201626587136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378131.483517:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626587136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378131.487011:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626587264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378131.487081:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378131.488133:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626587264 00000100:00100000:0.0:1787378131.488145:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626587264 00000100:00100000:0.0:1787378131.488194:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787378131.488203:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626587264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378131.488238:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378131.488298:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626587264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378131.488305:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787378131.490086:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae93f100 x1874201626587264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378131.490113:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626587264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787378131.929925:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787378132.551286:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1984c41f-3b43-4d7f-8b57-f1444ac920d9 00010000:00010000:0.0:1787378132.954514:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378133.629403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378133.629451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378133.629494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378133.629573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378133.629603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378133.629660:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604534528 00000100:00100000:2.0:1787378133.629670:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604534528 00000100:00100000:2.0:1787378133.629761:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604534400 00000100:00100000:2.0:1787378133.629764:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604534400 00000100:00100000:2.0:1787378133.629789:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1787378133.629798:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604534528:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378133.629890:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604534528:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 91us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378133.629897:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1787378133.629928:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:2.0:1787378133.629936:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604534400:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378133.629973:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604534400:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378133.629979:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00080000:2.0:1787378133.629999:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378133.632039:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604534272 00000100:00100000:0.0:1787378133.632052:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604534272 00000100:00100000:0.0:1787378133.632119:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:0.0:1787378133.632128:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604534272:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378133.632213:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604534272:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (2819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378133.632221:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:3.0:1787378133.640660:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604534784 00000100:00100000:3.0:1787378133.640675:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604534784 00000100:00100000:3.0:1787378133.640789:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604534656 00000100:00100000:3.0:1787378133.640793:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604534656 00000100:00100000:3.0:1787378133.640833:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1787378133.640842:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604534784:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378133.640937:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604534784:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 96us (11441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378133.640946:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1787378133.642109:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1787378133.642122:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604534656:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378133.642172:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604534656:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 56us (12570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378133.642179:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00080000:0.0:1787378133.642633:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787378133.642639:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787378133.978967:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787378134.436664:0:10170:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787378135.002693:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378136.029098:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378136.089933:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626587392:0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378136.090052:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626587904:0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090091:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378136.090121:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787378136.090126:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626587520:0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090146:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378136.090159:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626588032:0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378136.090204:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626587392 00000100:00100000:2.0:1787378136.090211:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626587392 00000100:00100000:2.0:1787378136.090259:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787378136.090267:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626587392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090312:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626587392:12345-0@lo:400:kworker.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378136.090329:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787378136.090362:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626587904 00000100:00100000:2.0:1787378136.090365:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626587904 00000100:00100000:2.0:1787378136.090397:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626587520 00000100:00100000:2.0:1787378136.090400:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626587520 00000100:00100000:2.0:1787378136.090415:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787378136.090420:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626587904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090451:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626587904:12345-0@lo:400:kworker.0 Request processed in 30us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378136.090457:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787378136.090469:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787378136.090474:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626587520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090499:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626587520:12345-0@lo:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378136.090505:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787378136.090547:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626587520:0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090556:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626587392:0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.090564:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626587904:0@lo:400:kworker.0 00000100:00100000:3.0:1787378136.090752:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626587648:0@lo:400:kworker.0 00000100:00100000:3.0:1787378136.090783:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378136.090808:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787378136.090814:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626587776:0@lo:400:kworker.0 00000100:00100000:3.0:1787378136.090835:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378136.090868:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626588032 00000100:00100000:3.0:1787378136.090872:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626588032 00000100:00100000:3.0:1787378136.090900:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626587776 00000100:00100000:3.0:1787378136.090903:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626587776 00000100:00100000:3.0:1787378136.090922:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787378136.090929:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626588032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378136.090978:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626588032:12345-0@lo:400:kworker.0 Request processed in 49us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378136.090985:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787378136.090998:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787378136.091004:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626587776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378136.091033:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626587776:12345-0@lo:400:kworker.0 Request processed in 29us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378136.091039:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787378136.091071:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf637480 x1874201626587776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378136.091081:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626587776:0@lo:400:kworker.0 00010000:00080000:3.0:1787378136.091104:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf635c00 x1874201626588032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378136.091112:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626588032:0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.091783:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626587648 00000100:00100000:2.0:1787378136.091789:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626587648 00000100:00100000:2.0:1787378136.091819:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787378136.091825:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626587648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378136.091873:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626587648:12345-0@lo:400:kworker.0 Request processed in 48us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378136.091878:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787378136.092049:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787378136.092053:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787378136.092056:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378136.092848:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626587648:0@lo:400:kworker.0 00000100:00100000:0.0:1787378136.601904:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787378136.601927:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626588160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378136.601994:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378136.602079:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626588288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378136.602108:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626588160 00000100:00100000:1.0:1787378136.602109:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378136.602116:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626588160 00000100:00100000:3.0:1787378136.602161:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626588288 00000100:00100000:3.0:1787378136.602164:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626588288 00000100:00100000:3.0:1787378136.602183:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787378136.602190:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626588160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378136.602222:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378136.602290:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626588160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378136.602298:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787378136.602314:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787378136.602332:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626588288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787378136.602350:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378136.602377:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626588288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378136.602383:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787378136.602558:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae704e00 x1874201626588160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378136.602573:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626588160:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787378136.602584:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae93ea00 x1874201626588288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378136.602593:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626588288:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787378137.051766:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378138.077656:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378138.755843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378138.756455:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604534912 00000100:00100000:3.0:1787378138.756465:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604534912 00000100:00100000:3.0:1787378138.756520:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:3.0:1787378138.756530:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2353:x1874201604534912:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378138.762593:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2353:x1874201604534912:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 6053us (6748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378138.762610:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:2.0:1787378138.765533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378138.766249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378138.766278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378138.766486:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604535424 00000100:00100000:1.0:1787378138.766495:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604535424 00000100:00100000:1.0:1787378138.766564:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1787378138.766580:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604535424:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378138.766653:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604535424:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 74us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378138.766670:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00080000:0.0:1787378138.767816:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787378138.768558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378138.768677:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604535168 00000100:00100000:3.0:1787378138.768685:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604535168 00000100:00100000:3.0:1787378138.768758:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604535040 00000100:00100000:3.0:1787378138.768762:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604535040 00000100:00100000:3.0:1787378138.768785:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:3.0:1787378138.768793:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604535168:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378138.768861:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604535168:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 68us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378138.768881:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:3.0:1787378138.768897:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:3.0:1787378138.768903:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604535040:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378138.768937:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604535040:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378138.768954:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:3.0:1787378138.768974:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604535296 00000100:00100000:3.0:1787378138.768977:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604535296 00000100:00100000:3.0:1787378138.769002:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1787378138.769008:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604535296:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378138.769033:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604535296:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378138.769038:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00080000:2.0:1787378138.769674:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378138.769680:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787378139.101199:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378140.122151:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378141.145852:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378141.209939:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787378141.209966:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626588544:0@lo:400:kworker.0 00000100:00100000:1.0:1787378141.210035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378141.210101:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626588672:0@lo:400:kworker.0 00000100:00100000:1.0:1787378141.210121:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378141.210170:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787378141.210177:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626589056:0@lo:400:kworker.0 00000100:00100000:1.0:1787378141.210201:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378141.210226:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626589056 00000100:00100000:1.0:1787378141.210233:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626589056 00000100:00100000:1.0:1787378141.210278:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787378141.210286:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626589056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378141.210345:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626589056:12345-0@lo:400:kworker.0 Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378141.210352:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787378141.210385:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae216300 x1874201626589056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378141.210399:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626589056:0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.210712:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626588416:0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.210797:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378141.210823:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626588928:0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.210845:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378141.210864:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787378141.210870:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626588800:0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.210889:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378141.210916:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626588544 00000100:00100000:3.0:1787378141.210920:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626588544 00000100:00100000:3.0:1787378141.210950:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626588672 00000100:00100000:3.0:1787378141.210953:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626588672 00000100:00100000:3.0:1787378141.210968:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626588928 00000100:00100000:3.0:1787378141.210970:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626588928 00000100:00100000:3.0:1787378141.210983:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787378141.210989:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626588544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.211024:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626588544:12345-0@lo:400:kworker.0 Request processed in 35us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378141.211030:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787378141.211054:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787378141.211060:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626588672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.211086:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626588672:12345-0@lo:400:kworker.0 Request processed in 27us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378141.211091:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787378141.211102:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787378141.211107:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626588928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.211136:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626588928:12345-0@lo:400:kworker.0 Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378141.211141:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787378141.211161:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626588800 00000100:00100000:3.0:1787378141.211164:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626588800 00000100:00100000:3.0:1787378141.211189:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787378141.211195:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626588800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.211222:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626588800:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378141.211228:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787378141.211244:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626588416 00000100:00100000:3.0:1787378141.211247:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626588416 00000100:00100000:3.0:1787378141.211269:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787378141.211275:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626588416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.211299:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626588416:12345-0@lo:400:kworker.0 Request processed in 25us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378141.211305:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00010000:00080000:3.0:1787378141.211370:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae216680 x1874201626588800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378141.211393:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626588800:0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.211405:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626588416:0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.211415:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626588928:0@lo:400:kworker.0 00000100:00100000:3.0:1787378141.211443:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626588672:0@lo:400:kworker.0 00000100:00080000:2.0:1787378141.211695:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378141.211700:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378141.211702:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787378141.212889:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626588544:0@lo:400:kworker.0 00000100:00100000:1.0:1787378141.721982:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378141.722008:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626589184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378141.722094:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378141.722095:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378141.722108:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626589312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787378141.722145:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378141.722174:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626589184 00000100:00100000:1.0:1787378141.722183:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626589184 00000100:00100000:0.0:1787378141.722183:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626589312 00000100:00100000:0.0:1787378141.722190:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626589312 00000100:00100000:1.0:1787378141.722689:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787378141.722756:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626589184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378141.722796:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378141.722853:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626589184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378141.722861:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787378141.722881:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787378141.722890:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626589312:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787378141.722899:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae216300 x1874201626589184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1787378141.722924:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378141.722924:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626589184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378141.722966:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626589312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378141.722972:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787378141.723002:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae93e680 x1874201626589312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378141.723015:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626589312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378142.169856:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378143.195177:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378143.866830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378143.866917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378143.866964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378143.866992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378143.867020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378143.867172:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604535808 00000100:00100000:0.0:1787378143.867181:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604535808 00000100:00100000:0.0:1787378143.867246:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604535680 00000100:00100000:0.0:1787378143.867249:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604535680 00000100:00100000:0.0:1787378143.867273:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:0.0:1787378143.867281:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604535808:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378143.867361:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604535808:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 80us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378143.867367:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:0.0:1787378143.867382:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:0.0:1787378143.867388:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604535680:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378143.867407:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604535680:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378143.867412:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00080000:2.0:1787378143.867465:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378143.867632:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604536064 00000100:00100000:1.0:1787378143.867636:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604536064 00000100:00100000:1.0:1787378143.867682:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604535936 00000100:00100000:1.0:1787378143.867685:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604535936 00000100:00100000:1.0:1787378143.867707:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1787378143.867712:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604536064:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378143.867769:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604536064:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 56us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378143.867789:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1787378143.867802:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1787378143.867808:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604535936:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378143.867833:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604535936:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378143.867839:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00080000:2.0:1787378143.868586:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378143.868591:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787378143.869472:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604535552 00000100:00100000:3.0:1787378143.869482:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604535552 00000100:00100000:3.0:1787378143.870805:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:3.0:1787378143.870816:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604535552:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378143.870896:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604535552:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 82us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378143.870903:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 225 00010000:00010000:1.0:1787378144.217918:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378145.244559:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378146.267309:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378146.330179:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626589440:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378146.330301:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626589952:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330329:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378146.330354:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378146.330360:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626589824:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330382:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378146.330409:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626589696:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330431:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378146.330447:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787378146.330452:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626589568:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330471:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378146.330485:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626590080:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330505:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378146.330532:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626589440 00000100:00100000:1.0:1787378146.330539:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626589440 00000100:00100000:1.0:1787378146.330615:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787378146.330625:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626589440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330673:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626589440:12345-0@lo:400:kworker.0 Request processed in 50us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378146.330680:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787378146.330709:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626589824 00000100:00100000:1.0:1787378146.330713:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626589824 00000100:00100000:1.0:1787378146.330766:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626590080 00000100:00100000:1.0:1787378146.330769:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626590080 00000100:00100000:1.0:1787378146.330790:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787378146.330796:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626589824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330827:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626589824:12345-0@lo:400:kworker.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378146.330833:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787378146.330844:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787378146.330850:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626590080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330880:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626590080:12345-0@lo:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378146.330886:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787378146.330903:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626589952 00000100:00100000:1.0:1787378146.330906:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626589952 00000100:00100000:1.0:1787378146.330931:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626589696 00000100:00100000:1.0:1787378146.330933:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626589696 00000100:00100000:1.0:1787378146.330945:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626589568 00000100:00100000:1.0:1787378146.330947:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626589568 00000100:00100000:1.0:1787378146.330958:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787378146.330964:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626589952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.330992:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626589952:12345-0@lo:400:kworker.0 Request processed in 28us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378146.331004:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787378146.331017:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787378146.331023:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626589696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.331049:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626589696:12345-0@lo:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378146.331055:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787378146.331065:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787378146.331070:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626589568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.331092:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626589568:12345-0@lo:400:kworker.0 Request processed in 22us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378146.331098:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787378146.331123:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787378146.331127:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378146.331129:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378146.331160:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626589568:0@lo:400:kworker.0 00010000:00080000:1.0:1787378146.331171:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae215f80 x1874201626590080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378146.331180:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626590080:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.331189:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626589696:0@lo:400:kworker.0 00010000:00080000:1.0:1787378146.331216:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae215180 x1874201626589824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378146.331224:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626589824:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.331232:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626589440:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.331251:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626589952:0@lo:400:kworker.0 00000100:00100000:1.0:1787378146.846864:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626590208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378146.846938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378146.847034:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626590208 00000100:00100000:1.0:1787378146.847042:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626590208 00000100:00100000:1.0:1787378146.847086:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787378146.847095:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626590208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378146.847134:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378146.847180:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626590208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378146.847188:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787378146.847230:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae98b800 x1874201626590208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378146.847249:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626590208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787378146.847772:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626590336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378146.847809:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378146.847852:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626590336 00000100:00100000:0.0:1787378146.847857:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626590336 00000100:00100000:0.0:1787378146.847886:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787378146.847893:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626590336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378146.847915:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378146.847949:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626590336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378146.847955:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787378146.848010:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae93e300 x1874201626590336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378146.848026:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626590336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787378147.290080:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378148.313929:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378148.990078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378148.990135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378148.990171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378148.990216:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604536320 00000100:00100000:2.0:1787378148.990228:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604536320 00000100:00100000:2.0:1787378148.990303:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604536448 00000100:00100000:2.0:1787378148.990307:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604536448 00000100:00100000:2.0:1787378148.990336:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1787378148.990348:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604536320:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378148.990456:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604536320:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 109us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378148.990466:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1787378148.990488:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:2.0:1787378148.990495:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604536448:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378148.990522:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604536448:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378148.990529:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00080000:2.0:1787378148.990547:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378148.991555:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604536192 00000100:00100000:3.0:1787378148.991585:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604536192 00000100:00100000:3.0:1787378148.991789:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:3.0:1787378148.991798:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604536192:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378148.991875:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604536192:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 77us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378148.991882:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:1.0:1787378148.992047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378148.992164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378148.992189:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604536576 00000100:00100000:1.0:1787378148.992194:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604536576 00000100:00100000:1.0:1787378148.992234:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604536704 00000100:00100000:1.0:1787378148.992237:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604536704 00000100:00100000:1.0:1787378148.992261:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1787378148.992267:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2352:x1874201604536576:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1787378148.992291:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852cff 00000100:00080000:1.0:1787378148.992321:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9eeb8761c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787378148.992367:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787378148.992804:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+2:2352:x1874201604536576:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 534us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378148.992812:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1787378148.992828:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1787378148.992835:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2352:x1874201604536704:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1787378148.992850:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852d06 00000100:00080000:1.0:1787378148.992856:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9eeb8761f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787378148.992880:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787378148.993080:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+2:2352:x1874201604536704:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 245us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378148.993088:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00010000:00010000:1.0:1787378148.993119:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378148.993454:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787378148.993624:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378148.993630:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787378149.342953:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787378149.534623:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1984c41f-3b43-4d7f-8b57-f1444ac920d9 00000020:00000080:3.0:1787378149.534642:0:7491:0:(genops.c:906:class_export_put()) final put ffff9eeb8761b000/1984c41f-3b43-4d7f-8b57-f1444ac920d9 00000020:00000080:3.0:1787378149.534668:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb8761b000/1984c41f-3b43-4d7f-8b57-f1444ac920d9 for lustre-OST0001 00000020:00000080:3.0:1787378149.534709:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb8761f800 for lustre-OST0001 00010000:00010000:1.0:1787378150.361923:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787378151.185166:0:10871:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787378151.386081:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378151.449993:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626590592:0@lo:400:kworker.0 00000100:00100000:1.0:1787378151.450090:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378151.450165:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626591104:0@lo:400:kworker.0 00000100:00100000:1.0:1787378151.450195:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378151.450231:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378151.450238:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626590720:0@lo:400:kworker.0 00000100:00100000:1.0:1787378151.450262:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378151.450303:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626590592 00000100:00100000:1.0:1787378151.450313:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626590592 00000100:00100000:1.0:1787378151.450364:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626590720 00000100:00100000:1.0:1787378151.450368:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626590720 00000100:00100000:1.0:1787378151.450401:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787378151.450557:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626590848:0@lo:400:kworker.0 00000100:00100000:3.0:1787378151.450601:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378151.450625:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787378151.450631:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626590464:0@lo:400:kworker.0 00000100:00100000:3.0:1787378151.450663:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378151.450685:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626590976:0@lo:400:kworker.0 00000100:00100000:3.0:1787378151.450706:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378151.450753:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626590464 00000100:00100000:3.0:1787378151.450757:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626590464 00000100:00100000:3.0:1787378151.450788:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787378151.450797:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626590464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378151.450868:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626590464:12345-0@lo:400:kworker.0 Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378151.450876:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787378151.450938:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626590464:0@lo:400:kworker.0 00000100:00080000:2.0:1787378151.451138:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378151.451237:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626590592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378151.451322:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626590592:12345-0@lo:400:kworker.0 Request processed in 91us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378151.451330:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787378151.451344:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626590976 00000100:00100000:1.0:1787378151.451347:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626590976 00000100:00100000:1.0:1787378151.451382:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787378151.451388:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626590720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378151.451427:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626590720:12345-0@lo:400:kworker.0 Request processed in 30us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378151.451434:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787378151.451445:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787378151.451452:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626590976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378151.451486:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626590976:12345-0@lo:400:kworker.0 Request processed in 34us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378151.451492:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787378151.451513:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626591104 00000100:00100000:1.0:1787378151.451517:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626591104 00000100:00100000:1.0:1787378151.451544:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626590848 00000100:00100000:1.0:1787378151.451547:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626590848 00000100:00100000:1.0:1787378151.451567:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787378151.451585:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626591104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378151.451619:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626591104:12345-0@lo:400:kworker.0 Request processed in 35us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378151.451625:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787378151.451636:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787378151.451641:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626590848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378151.451682:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626590848:12345-0@lo:400:kworker.0 Request processed in 41us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378151.451688:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787378151.451761:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626590976:0@lo:400:kworker.0 00010000:00080000:1.0:1787378151.451774:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae214700 x1874201626590848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378151.451784:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626590848:0@lo:400:kworker.0 00000100:00080000:3.0:1787378151.452051:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787378151.452054:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787378151.452057:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378151.452128:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626590592:0@lo:400:kworker.0 00010000:00080000:2.0:1787378151.452141:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae216d80 x1874201626591104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378151.452152:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626591104:0@lo:400:kworker.0 00000100:00100000:2.0:1787378151.452237:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626590720:0@lo:400:kworker.0 00000100:00100000:2.0:1787378151.962171:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626591232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787378151.962197:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787378151.962217:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626591360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378151.968881:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378151.970527:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626591360 00000100:00100000:1.0:1787378151.970550:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626591360 00000100:00100000:1.0:1787378151.970663:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787378151.970687:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626591360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378151.970792:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378151.971452:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626591360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 776us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378151.971462:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787378151.971682:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae93e300 x1874201626591360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378151.971710:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626591360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378151.976359:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378151.976487:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626591232 00000100:00100000:1.0:1787378151.976501:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626591232 00000100:00100000:1.0:1787378151.976591:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787378151.976606:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626591232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378151.976662:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378151.976787:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626591232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378151.976796:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787378151.976974:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebaf44ed80 x1874201626591232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378151.976999:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626591232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378152.410297:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787378153.060610:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1984c41f-3b43-4d7f-8b57-f1444ac920d9 00000020:00000080:1.0:1787378153.060627:0:6613:0:(genops.c:906:class_export_put()) final put ffff9eeb87618800/1984c41f-3b43-4d7f-8b57-f1444ac920d9 00000020:00000080:0.0:1787378153.060698:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb87618800/1984c41f-3b43-4d7f-8b57-f1444ac920d9 for lustre-OST0000 00000020:00000080:0.0:1787378153.060772:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb8761c000 for lustre-OST0000 00010000:00010000:1.0:1787378153.435917:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378154.115020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378154.115074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378154.115100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378154.115134:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604536960 00000100:00100000:1.0:1787378154.115143:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604536960 00000100:00100000:1.0:1787378154.115197:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604537088 00000100:00100000:1.0:1787378154.115200:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604537088 00000100:00100000:1.0:1787378154.115221:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:1.0:1787378154.115231:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604536960:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378154.115309:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604536960:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378154.115317:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:1.0:1787378154.115335:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1787378154.115355:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604537088:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378154.115377:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604537088:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378154.115383:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1787378154.115399:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604536832 00000100:00100000:1.0:1787378154.115402:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604536832 00000100:00100000:1.0:1787378154.115424:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:1.0:1787378154.115429:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604536832:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378154.115449:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604536832:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378154.115454:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00080000:1.0:1787378154.115491:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787378154.463506:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787378155.371591:0:11020:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffec8feccc0 00000020:00000080:3.0:1787378155.371612:0:11020:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787378155.371617:0:11020:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787378155.371637:0:11020:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec8feef50 20000000:00000080:3.0:1787378155.371646:0:11020:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eeb9dd03c00 uarg=0000000000000000 20000000:01000000:3.0:1787378155.371685:0:11020:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787378155.371691:0:11020:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787378155.371696:0:11020:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787378155.372674:0:11021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787378155.373074:0:11020:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787378155.394243:0:11020:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787378155.395906:0:11020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.395932:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.395941:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.395948:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.395954:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.395961:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.395968:0:11020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.396009:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.396023:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 12 pid: 5786 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.396037:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626591488:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378155.396153:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.396175:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 18 pid: 5785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.396185:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626591616:0@lo:104: 00000100:00100000:2.0:1787378155.396981:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787378155.397029:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.397039:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 18 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.397049:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626591744:0@lo:104: 00000100:00100000:2.0:1787378155.397078:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787378155.397108:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.397115:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 18 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.397123:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626591872:0@lo:104: 00000100:00100000:2.0:1787378155.397144:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787378155.397162:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.397169:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 12 pid: 5783 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.397177:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626592000:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378155.397221:0:11020:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378155.397282:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626591616 00000100:00100000:1.0:1787378155.397290:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626591616 00000100:00100000:1.0:1787378155.397328:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626591744 00000100:00100000:1.0:1787378155.397330:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626591744 00000100:00100000:1.0:1787378155.397340:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626591872 00000100:00100000:1.0:1787378155.397342:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626591872 00000100:00100000:1.0:1787378155.397353:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787378155.397360:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:11020:x1874201626591616:12345-0@lo:104: 00010000:00010000:1.0:1787378155.397372:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397432:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378155.397438:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+5:11020:x1874201626591616:12345-0@lo:104: Request processed in 78us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378155.397445:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787378155.397460:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787378155.397466:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:11020:x1874201626591744:12345-0@lo:104: 00010000:00010000:1.0:1787378155.397473:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397504:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787378155.397510:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:11020:x1874201626591744:12345-0@lo:104: Request processed in 45us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378155.397515:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787378155.397527:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787378155.397533:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:11020:x1874201626591872:12345-0@lo:104: 00010000:00010000:1.0:1787378155.397540:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397595:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787378155.397600:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:11020:x1874201626591872:12345-0@lo:104: Request processed in 67us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378155.397606:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787378155.397621:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787378155.397627:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397634:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546800 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378155.397638:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397646:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378155.397653:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378155.397659:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787378155.397687:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397694:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378155.397713:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397742:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81546800/0xdd3c5462d7852cd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cdc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397764:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787378155.397767:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397772:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546200 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378155.397775:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397782:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378155.397789:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378155.397793:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787378155.397822:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397835:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378155.397851:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397857:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81546200/0xdd3c5462d7852cc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cce expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397867:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378155.397870:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397886:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378155.397889:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397895:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378155.397900:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378155.397904:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787378155.397919:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397924:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378155.397929:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397948:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81547e00/0xdd3c5462d7852cb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852cc0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.397963:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378155.397965:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378155.397967:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378155.397974:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378155.397979:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378155.397999:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626592128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378155.398030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378155.398065:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626592256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378155.398096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378155.398114:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378155.398120:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626592384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378155.398139:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378155.398379:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626592128 00000100:00100000:1.0:1787378155.398384:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626592128 00010000:00010000:1.0:1787378155.398407:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 19 pid: 5785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378155.398428:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626592256 00000100:00100000:1.0:1787378155.398430:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626592256 00010000:00010000:1.0:1787378155.398440:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 20 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378155.398455:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626592384 00000100:00100000:1.0:1787378155.398457:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626592384 00010000:00010000:1.0:1787378155.398466:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 21 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378155.398477:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787378155.398482:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+21:3314:x1874201626592128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378155.398492:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378155.398496:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 21 pid: 5785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.398505:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 21 pid: 5785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.398520:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378155.398559:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+21:3314:x1874201626592128:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378155.398571:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787378155.398610:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787378155.398616:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3311:x1874201626592256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378155.398623:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378155.398628:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 20 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.398636:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 20 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.398645:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378155.398672:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3311:x1874201626592256:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378155.398678:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787378155.398689:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787378155.398695:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626592384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378155.398702:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378155.398706:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 19 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.398713:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 19 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378155.398742:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378155.398762:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626592384:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378155.398768:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787378155.399624:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81546000/0xdd3c5462d7852cdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852cd5 expref: 18 pid: 5785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.399639:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626591616:0@lo:104: 00010000:00010000:2.0:1787378155.399650:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81547c00/0xdd3c5462d7852cce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852cc7 expref: 17 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.399659:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626591744:0@lo:104: 00010000:00010000:2.0:1787378155.399669:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852cc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852cb9 expref: 16 pid: 5786 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.399677:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626591872:0@lo:104: 00000100:00100000:0.0:1787378155.400051:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626592384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787378155.400060:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626592256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378155.400995:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626592128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787378155.402689:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626591488:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378155.402751:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378155.402906:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1874201626592000:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378155.402938:0:11020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378155.403018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378155.403467:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604537216 00000100:00100000:2.0:1787378155.403479:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604537216 00010000:00010000:2.0:1787378155.403512:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 13 pid: 5786 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.403555:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604537344 00000100:00100000:2.0:1787378155.403558:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604537344 00010000:00010000:2.0:1787378155.403570:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 14 pid: 5783 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.403599:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:2.0:1787378155.403608:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a49b169-b438-4a59-90b0-00ee704ad017+14:2353:x1874201604537216:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378155.403622:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378155.403627:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 14 pid: 5786 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.403657:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 14 pid: 5786 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.403675:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd05c00/0xdd3c5462d7852cf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d94 expref: 14 pid: 5786 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378155.403690:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378155.403752:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1787378155.403761:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604537344:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378155.403769:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378155.403774:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 13 pid: 5783 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403783:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 13 pid: 5783 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403794:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7852cb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d5c expref: 13 pid: 5783 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403820:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403853:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403868:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403874:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403880:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403886:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403892:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378155.403896:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403903:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403918:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.403927:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378155.403972:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a49b169-b438-4a59-90b0-00ee704ad017+12:2354:x1874201604537344:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 211us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378155.403980:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00010000:00010000:3.0:1787378155.404006:0:11020:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.404019:0:11020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378155.404032:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c7000/0xdd3c5462d7852d0d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378155.405477:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a49b169-b438-4a59-90b0-00ee704ad017+11:2353:x1874201604537216:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1862us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378155.405488:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00010000:00010000:1.0:1787378155.484509:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378156.508815:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378156.569945:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626592640:0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570014:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378156.570023:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626592512:0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570066:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626593152:0@lo:400:kworker.0 00000100:00100000:3.0:1787378156.570074:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378156.570096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378156.570111:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626593024:0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570135:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626592768:0@lo:400:kworker.0 00000100:00100000:3.0:1787378156.570142:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378156.570165:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378156.570188:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626592512 00000100:00100000:1.0:1787378156.570189:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787378156.570196:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626592512 00000100:00100000:1.0:1787378156.570197:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626592896:0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570224:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378156.570250:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787378156.570253:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626592640 00000100:00100000:1.0:1787378156.570258:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626592640 00000100:00100000:3.0:1787378156.570262:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3313:x1874201626592512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570287:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626593024 00000100:00100000:1.0:1787378156.570291:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626593024 00000100:00100000:1.0:1787378156.570312:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626592768 00000100:00100000:1.0:1787378156.570314:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626592768 00000100:00100000:1.0:1787378156.570330:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787378156.570340:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3313:x1874201626592512:12345-0@lo:400:kworker.0 Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.570340:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626592640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378156.570354:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787378156.570393:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787378156.570402:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626593024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570406:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626592640:12345-0@lo:400:kworker.0 Request processed in 67us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.570415:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787378156.570433:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787378156.570442:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626592768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570474:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626592768:12345-0@lo:400:kworker.0 Request processed in 35us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.570490:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787378156.570504:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626593024:12345-0@lo:400:kworker.0 Request processed in 103us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.570512:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626593152 00000100:00100000:3.0:1787378156.570513:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787378156.570518:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626593152 00000100:00100000:1.0:1787378156.570559:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626592896 00000100:00100000:1.0:1787378156.570563:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626592896 00000100:00100000:3.0:1787378156.570567:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626592512:0@lo:400:kworker.0 00000100:00100000:3.0:1787378156.570584:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626593024:0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570587:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787378156.570598:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626593152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570634:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626593152:12345-0@lo:400:kworker.0 Request processed in 39us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.570640:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787378156.570652:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787378156.570657:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626592896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570679:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626592896:12345-0@lo:400:kworker.0 Request processed in 22us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.570684:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787378156.570710:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787378156.570713:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378156.570716:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787378156.570770:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae711180 x1874201626592896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378156.570782:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626592896:0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570794:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626592768:0@lo:400:kworker.0 00000100:00100000:1.0:1787378156.570828:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626592640:0@lo:400:kworker.0 00010000:00080000:1.0:1787378156.570842:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebade83100 x1874201626593152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378156.570863:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626593152:0@lo:400:kworker.0 10000000:01000000:2.0:1787378156.572266:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787378156.572272:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebbb181000 from 7 10000000:01000000:2.0:1787378156.572277:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787378156.572315:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378156.572326:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378156.572336:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378156.572357:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787378156.572416:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378156.572453:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729180 going to sleep for 11 seconds 00000100:00100000:0.0:1787378156.576163:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626593280 00000100:00100000:0.0:1787378156.576179:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626593280 00000100:00100000:0.0:1787378156.577394:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787378156.577410:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626593280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787378156.577427:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378156.577449:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852d14 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378156.577479:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378156.577492:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378156.577515:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ae00, rc 0) 00000100:00100000:0.0:1787378156.577607:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626593280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (5189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378156.577614:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787378156.577691:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378156.577710:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378156.577745:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378156.577811:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378156.577842:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378156.577869:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729180 going to sleep for 11 seconds 00000100:00100000:3.0:1787378156.577925:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626593408 00000100:00100000:3.0:1787378156.577931:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626593408 00000100:00100000:3.0:1787378156.577967:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787378156.577974:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626593408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378156.578210:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626593408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378156.578217:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787378156.578405:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378156.578431:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378156.578464:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378156.578483:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729180 going to sleep for 11 seconds 00000100:00100000:0.0:1787378156.585762:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626593536 00000100:00100000:0.0:1787378156.585779:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626593536 00000100:00100000:3.0:1787378156.585924:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787378156.585934:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626593536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378156.586176:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626593536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (7710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378156.586185:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787378156.586599:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787378156.587495:0:11041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787378156.587797:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787378156.587816:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787378156.587827:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378156.587838:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378156.587848:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787378156.587851:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb88344000 from 7 10000000:01000000:3.0:1787378156.587854:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787378156.587886:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378156.587894:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378156.587929:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378156.587950:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787378156.587997:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378156.588029:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb905ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378156.588255:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626593664 00000100:00100000:1.0:1787378156.588261:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626593664 00000100:00100000:1.0:1787378156.588296:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787378156.588304:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626593664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378156.588315:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378156.588327:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852d22 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378156.588348:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378156.588359:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378156.588367:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546200, rc 0) 00000100:00100000:1.0:1787378156.588402:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626593664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.588409:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787378156.588522:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378156.588545:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378156.588555:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378156.588598:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378156.588619:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378156.588637:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb905ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378156.588680:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626593792 00000100:00100000:0.0:1787378156.588684:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626593792 00000100:00100000:0.0:1787378156.588712:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787378156.588738:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626593792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378156.588952:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626593792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378156.588959:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787378156.589024:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378156.589048:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378156.589080:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378156.589105:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb905ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378156.589148:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626593920 00000100:00100000:0.0:1787378156.589152:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626593920 00000100:00100000:0.0:1787378156.589178:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787378156.589184:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626593920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787378156.589305:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626593920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378156.589311:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787378156.589379:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626593920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787378156.590273:0:11042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787378156.590440:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787378156.590454:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787378156.590463:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378156.590472:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378156.590488:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787378156.590490:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb8a31b800 from 7 10000000:01000000:0.0:1787378156.590493:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787378156.590517:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378156.590525:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378156.590546:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378156.590564:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626594048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787378156.590604:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378156.590634:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf717e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378156.591385:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626594048 00000100:00100000:3.0:1787378156.591393:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626594048 00000100:00100000:3.0:1787378156.591473:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787378156.591481:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626594048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378156.591494:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378156.591505:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852d30 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378156.591525:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378156.591546:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378156.591555:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04800, rc 0) 00000100:00100000:3.0:1787378156.591604:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626594048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378156.591610:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787378156.591800:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626594048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378156.591814:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378156.591823:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378156.591874:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626594176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378156.591900:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378156.592064:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787378156.592331:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626594176 00000100:00100000:1.0:1787378156.592336:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626594176 00000100:00100000:1.0:1787378156.592360:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787378156.592365:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626594176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378156.592600:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626594176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.592612:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787378156.592685:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626594176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378156.592826:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626594304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378156.592862:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378156.592915:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787378156.592989:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626594304 00000100:00100000:3.0:1787378156.592993:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626594304 00000100:00100000:1.0:1787378156.593052:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787378156.593059:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626594304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378156.593193:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626594304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378156.593199:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787378156.593255:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626594304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787378156.594049:0:11043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787378156.594207:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787378156.594222:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787378156.594230:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378156.594239:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378157.086952:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626594432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378157.087021:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378157.087100:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626594432 00000100:00100000:3.0:1787378157.087107:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626594432 00000100:00100000:3.0:1787378157.087150:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787378157.087159:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626594432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378157.087193:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378157.087371:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626594432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 211us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378157.087379:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787378157.087429:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae706300 x1874201626594432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378157.087447:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626594432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378157.092457:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626594560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378157.092542:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378157.092752:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626594560 00000100:00100000:0.0:1787378157.092760:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626594560 00000100:00100000:0.0:1787378157.092807:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787378157.092816:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626594560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378157.092851:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378157.092895:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626594560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378157.092903:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787378157.093036:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae93f480 x1874201626594560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378157.093054:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626594560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787378157.117541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378157.117614:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604537472 00000100:00100000:3.0:1787378157.117624:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604537472 00000100:00100000:3.0:1787378157.117678:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:3.0:1787378157.117687:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+11:5570:x1874201604537472:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378157.117703:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378157.117751:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6dbe expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378157.117779:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378157.117791:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378157.117801:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05600, rc 0) 00000100:00100000:3.0:1787378157.117851:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604537472:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 165us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378157.117859:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:0.0:1787378157.122354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378157.130422:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604537600 00000100:00100000:3.0:1787378157.130438:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604537600 00000100:00100000:3.0:1787378157.130500:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:3.0:1787378157.130511:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604537600:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378157.130818:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604537600:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 308us (8471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378157.130837:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:1.0:1787378157.137062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378157.137129:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604537728 00000100:00100000:2.0:1787378157.137139:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604537728 00000100:00100000:2.0:1787378157.137190:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 242 00000100:00100000:2.0:1787378157.137272:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604537728:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378157.137496:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604537728:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 296us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378157.137504:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 242 00000100:00100000:0.0:1787378157.148310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378157.148658:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604537856 00000100:00100000:3.0:1787378157.148668:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604537856 00000100:00100000:3.0:1787378157.148744:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 243 00000100:00100000:3.0:1787378157.148754:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604537856:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378157.148771:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378157.148798:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6dc5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378157.148825:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378157.148837:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378157.148846:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05400, rc 0) 00000100:00100000:3.0:1787378157.148895:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604537856:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 142us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378157.148903:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 243 00000100:00100000:1.0:1787378157.151706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378157.151927:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604537984 00000100:00100000:3.0:1787378157.151936:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604537984 00000100:00100000:3.0:1787378157.151983:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 244 00000100:00100000:3.0:1787378157.151991:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb87629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604537984:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378157.152640:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb87629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604537984:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 646us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378157.152649:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 244 00000100:00100000:1.0:1787378157.160439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378157.160540:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604538112 00000100:00100000:0.0:1787378157.160562:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604538112 00000100:00100000:0.0:1787378157.160625:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 245 00000100:00100000:0.0:1787378157.160635:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604538112:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378157.161401:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604538112:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 763us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378157.161411:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 245 00010000:00010000:1.0:1787378157.529988:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378158.553838:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378159.230802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378159.230849:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378159.230877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378159.230908:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604538368 00000100:00100000:0.0:1787378159.230917:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604538368 00000100:00100000:0.0:1787378159.230970:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604538496 00000100:00100000:0.0:1787378159.230973:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604538496 00000100:00100000:0.0:1787378159.230995:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:0.0:1787378159.231005:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604538368:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378159.231077:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604538368:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378159.231085:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:0.0:1787378159.231100:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:0.0:1787378159.231106:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604538496:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378159.231129:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604538496:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378159.231135:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00080000:0.0:1787378159.231150:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378159.232061:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604538240 00000100:00100000:3.0:1787378159.232069:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604538240 00000100:00100000:3.0:1787378159.232179:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 246 00000100:00100000:3.0:1787378159.232263:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb87628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604538240:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378159.232321:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb87628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604538240:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 135us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378159.232328:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 246 00010000:00010000:1.0:1787378159.578770:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787378160.219584:0:11218:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787378160.602440:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378161.629082:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378161.690373:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626594816:0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.690443:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378161.690495:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626595328:0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.690530:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378161.690560:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787378161.690566:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626594688:0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.690592:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378161.690610:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626595200:0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.690628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378161.690648:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626594944:0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.690669:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378161.690683:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787378161.690688:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626595072:0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.690747:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378161.690790:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626595328 00000100:00100000:3.0:1787378161.690798:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626595328 00000100:00100000:3.0:1787378161.690858:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626595072 00000100:00100000:3.0:1787378161.690861:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626595072 00000100:00100000:3.0:1787378161.691069:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787378161.691092:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626595328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.691143:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626595328:12345-0@lo:400:kworker.0 Request processed in 51us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378161.691149:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787378161.691165:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787378161.691171:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626595072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.691200:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626595072:12345-0@lo:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378161.691205:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787378161.691222:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626594688 00000100:00100000:3.0:1787378161.691226:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626594688 00000100:00100000:3.0:1787378161.691247:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787378161.691253:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626594688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.691279:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626594688:12345-0@lo:400:kworker.0 Request processed in 26us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378161.691285:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00010000:00080000:3.0:1787378161.691334:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae706d80 x1874201626595072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378161.691347:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626595072:0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.691375:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626594688:0@lo:400:kworker.0 00010000:00080000:3.0:1787378161.691386:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae704e00 x1874201626595328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378161.691395:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626595328:0@lo:400:kworker.0 00000100:00100000:0.0:1787378161.691669:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626594816 00000100:00100000:0.0:1787378161.691674:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626594816 00000100:00100000:0.0:1787378161.691741:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626595200 00000100:00100000:0.0:1787378161.691745:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626595200 00000100:00100000:0.0:1787378161.691770:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626594944 00000100:00100000:0.0:1787378161.691772:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626594944 00000100:00100000:0.0:1787378161.691800:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787378161.691806:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626594816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378161.691862:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626594816:12345-0@lo:400:kworker.0 Request processed in 56us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378161.691867:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787378161.692129:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626594816:0@lo:400:kworker.0 00000100:00080000:1.0:1787378161.692617:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787378161.692622:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787378161.692624:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787378161.695854:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787378161.695880:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626595200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378161.696107:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787378161.696118:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626594944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378161.696145:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626595200:12345-0@lo:400:kworker.0 Request processed in 277us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378161.696155:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787378161.696165:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626594944:12345-0@lo:400:kworker.0 Request processed in 50us (5494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378161.696172:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787378161.696230:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626594944:0@lo:400:kworker.0 00000100:00100000:1.0:1787378161.696329:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626595200:0@lo:400:kworker.0 00000100:00100000:3.0:1787378162.202486:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626595456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378162.202575:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378162.202646:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626595456 00000100:00100000:3.0:1787378162.202653:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626595456 00000100:00100000:3.0:1787378162.202710:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787378162.202735:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626595456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378162.203226:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378162.203278:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626595456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 560us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378162.203286:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787378162.203344:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae713b80 x1874201626595456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378162.203362:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626595456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378162.206370:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378162.206393:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626595584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378162.206468:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378162.206991:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626595584 00000100:00100000:3.0:1787378162.206999:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626595584 00000100:00100000:3.0:1787378162.207051:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787378162.207060:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626595584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787378162.207095:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378162.207175:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626595584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378162.207183:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787378162.208086:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae705500 x1874201626595584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378162.208120:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626595584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378162.649900:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378163.674179:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378164.356432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378164.356501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378164.356539:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604538624 00000100:00100000:2.0:1787378164.356552:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604538624 00000100:00100000:2.0:1787378164.356616:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:2.0:1787378164.356628:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604538624:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378164.356750:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604538624:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 122us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378164.356759:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:3.0:1787378164.356976:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604538752 00000100:00100000:3.0:1787378164.356981:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604538752 00000100:00100000:3.0:1787378164.357039:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:3.0:1787378164.357048:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604538752:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378164.357086:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604538752:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378164.357093:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00080000:1.0:1787378164.357214:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378164.368411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378164.368506:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604538880 00000100:00100000:2.0:1787378164.368520:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604538880 00000100:00100000:2.0:1787378164.368614:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1787378164.368626:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604538880:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378164.368753:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604538880:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 128us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378164.368762:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00080000:0.0:1787378164.369118:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787378164.700628:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787378165.045507:0:11318:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:56:03 (1787378163) === 00000100:00100000:2.0:1787378165.322452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378165.322509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378165.322764:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604539008 00000100:00100000:0.0:1787378165.322777:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604539008 00000100:00100000:0.0:1787378165.322830:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1787378165.322839:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604539008:12345-192.168.203.22@tcp:41:mkdir.0 00000004:00000024:0.0:1787378165.322885:0:5790:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787378165.322974:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604539008:12345-192.168.203.22@tcp:41:mkdir.0 Request processed in 135us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378165.322981:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1787378165.328495:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604539136 00000100:00100000:1.0:1787378165.328509:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604539136 00000100:00100000:1.0:1787378165.328563:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787378165.328572:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:9674:x1874201604539136:12345-192.168.203.22@tcp:700:mkdir.0 00000100:00100000:1.0:1787378165.328657:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:9674:x1874201604539136:12345-192.168.203.22@tcp:700:mkdir.0 Request processed in 86us (6147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378165.328665:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1787378165.343128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378165.343205:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604539392 00000100:00100000:2.0:1787378165.343215:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604539392 00000100:00100000:2.0:1787378165.343344:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787378165.343355:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:9674:x1874201604539392:12345-192.168.203.22@tcp:36:mkdir.0 00010000:00010000:2.0:1787378165.343411:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378165.343454:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852c2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d47 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.343472:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4c00) 00010000:00010000:2.0:1787378165.343493:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378165.344988:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.345010:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.345021:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.345033:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.345039:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.345045:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378165.352712:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787378165.353625:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.353637:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.353645:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.353663:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378165.353667:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.353676:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.353692:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ed00) 00010000:00010000:2.0:1787378165.353695:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378165.353699:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.353705:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d4c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378165.354112:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bef3c6bc reply state 000000000f384467 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378165.354124:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378165.354242:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:9674:x1874201604539392:12345-192.168.203.22@tcp:36:mkdir.0 Request processed in 10885us (11121us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787378165.354251:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00010000:00010000:3.0:1787378165.365056:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.365079:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.365088:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.365095:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.365101:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.365110:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.365130:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eeba261e900) 00010000:00010000:3.0:1787378165.365134:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378165.365147:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.365154:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d53 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378165.368116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.368285:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604539520 00000100:00100000:3.0:1787378165.368295:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604539520 00000100:00100000:3.0:1787378165.368359:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1787378165.368371:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:9675:x1874201604539520:12345-192.168.203.22@tcp:101:chmod.0 00010000:00010000:3.0:1787378165.368394:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378165.368418:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6dcc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.368501:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852d61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.368514:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.368525:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378165.368586:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787378165.368590:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378165.368632:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.368659:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dcc expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.368677:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852d61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dcc expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.368700:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4300) 00010000:00010000:3.0:1787378165.368704:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378165.368708:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05800, rc 0) 00000100:00100000:3.0:1787378165.369074:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:9675:x1874201604539520:12345-192.168.203.22@tcp:101:chmod.0 Request processed in 703us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378165.369083:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1787378165.377852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378165.378025:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604539776 00000100:00100000:0.0:1787378165.378034:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604539776 00000100:00100000:0.0:1787378165.378095:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1787378165.378106:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:9675:x1874201604539776:12345-192.168.203.22@tcp:36:chmod.0 00010000:00010000:0.0:1787378165.378166:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378165.378197:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852d61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dcc expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.378218:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4300) 00010000:00010000:0.0:1787378165.378229:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378165.378287:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.378300:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.378310:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378165.378638:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035def00a reply state 000000001b33fd5c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378165.378649:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787378165.378664:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787378165.379126:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:9675:x1874201604539776:12345-192.168.203.22@tcp:36:chmod.0 Request processed in 1020us (1283us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787378165.379135:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00010000:00010000:3.0:1787378165.393845:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.393867:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.393875:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.393881:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.393885:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.393894:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.393914:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:3.0:1787378165.393917:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787378165.393921:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.393927:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7852d68 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378165.407395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.407435:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604539904 00000100:00100000:3.0:1787378165.407446:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604539904 00000100:00100000:3.0:1787378165.407509:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1787378165.407518:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:9676:x1874201604539904:12345-192.168.203.22@tcp:101:chown.0 00010000:00010000:3.0:1787378165.407543:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378165.407566:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6dd3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.407632:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852d76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.407646:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852d76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.407657:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852d76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378165.408205:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787378165.408211:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378165.408262:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852d76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.408292:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dd3 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.408309:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852d76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dd3 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.408339:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:3.0:1787378165.408342:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378165.408345:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05a00, rc 0) 00000100:00100000:3.0:1787378165.408404:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:9676:x1874201604539904:12345-192.168.203.22@tcp:101:chown.0 Request processed in 885us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378165.408412:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1787378165.426367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378165.426534:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604540032 00000100:00100000:2.0:1787378165.426546:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604540032 00000100:00100000:2.0:1787378165.426651:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787378165.426662:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:9676:x1874201604540032:12345-192.168.203.22@tcp:101:chown.0 00010000:00010000:2.0:1787378165.426685:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378165.426709:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6dda expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.426833:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.426847:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.426859:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.426874:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.426882:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.426889:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.426994:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427002:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427008:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378165.427045:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787378165.427049:0:9982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378165.427075:0:9982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427098:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427104:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427111:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427117:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378165.427121:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427130:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427144:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:2.0:1787378165.427147:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378165.427152:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427157:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852d84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427171:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427177:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427182:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427193:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378165.427195:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427201:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427209:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eeba261ed00) 00010000:00010000:2.0:1787378165.427211:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378165.427213:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427219:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852d8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427253:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852d7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dda expref: 10 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427267:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dda expref: 9 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.427275:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378165.427278:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378165.427280:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7200, rc 0) 00000100:00100000:2.0:1787378165.427356:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:9676:x1874201604540032:12345-192.168.203.22@tcp:101:chown.0 Request processed in 695us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378165.427364:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1787378165.431000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.431164:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604540288 00000100:00100000:3.0:1787378165.431181:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604540288 00000100:00100000:3.0:1787378165.432239:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1787378165.433143:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:9676:x1874201604540288:12345-192.168.203.22@tcp:36:chown.0 00010000:00010000:3.0:1787378165.433825:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378165.433867:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dda expref: 9 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.433896:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:3.0:1787378165.433909:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378165.433945:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.433961:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.433973:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378165.514498:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1787378165.514530:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787378165.514654:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f85b1eb reply state 000000006129453b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378165.514670:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787378165.523649:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787378165.523779:0:5790:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787378165.523814:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:9676:x1874201604540288:12345-192.168.203.22@tcp:36:chown.0 Request processed in 91556us (92819us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787378165.523825:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00010000:00010000:1.0:1787378165.523989:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.524000:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.524008:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.524014:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378165.524028:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.524036:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.524076:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4b00) 00010000:00010000:1.0:1787378165.524079:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787378165.524085:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.524090:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852d99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378165.554126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.554435:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604540416 00000100:00100000:3.0:1787378165.554446:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604540416 00000100:00100000:3.0:1787378165.554535:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1787378165.554545:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:9677:x1874201604540416:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:3.0:1787378165.554569:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378165.554590:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7852da0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6de1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787378165.556395:0:5792:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1753us 00010000:00010000:3.0:1787378165.588696:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.588746:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.588760:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.588778:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.588784:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.588791:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589604:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852db5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589616:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589624:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378165.589756:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787378165.589761:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378165.589857:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589871:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589877:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589884:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589889:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.589894:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589901:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589914:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:3.0:1787378165.589917:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378165.589922:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589929:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852da7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589956:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589972:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589979:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589983:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.589987:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.589993:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.590002:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eeb97cb4300) 00010000:00010000:3.0:1787378165.590004:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378165.590008:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.590015:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852dae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.592946:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7852da0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6de1 expref: 8 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.592972:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6de1 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.592982:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:3.0:1787378165.592985:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787378165.592998:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05800, rc 0) 00000100:00100000:3.0:1787378165.593549:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:9677:x1874201604540416:12345-192.168.203.22@tcp:101:touch.500 Request processed in 39000us (39428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378165.593559:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1787378165.599317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.599515:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604540672 00000100:00100000:3.0:1787378165.599526:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604540672 00000100:00100000:3.0:1787378165.599592:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1787378165.599601:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:9677:x1874201604540672:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:3.0:1787378165.599623:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378165.599644:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852dbc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6de8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.600240:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.600257:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.600269:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.600328:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.600336:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.600343:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787378165.602661:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787378165.606409:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852dd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606432:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606444:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606493:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606500:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606507:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606513:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.606517:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606524:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606536:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:3.0:1787378165.606539:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378165.606544:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606551:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852dc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787378165.606577:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da80f6e9 reply state 00000000f02aae18 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378165.606588:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787378165.606629:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852dbc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6de8 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606644:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6de8 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.606652:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eeb97cb4700) 00010000:00010000:3.0:1787378165.606654:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378165.606657:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81485400, rc 0) 00000100:00100000:3.0:1787378165.606752:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:9677:x1874201604540672:12345-192.168.203.22@tcp:101:touch.500 Request processed in 7151us (7445us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787378165.606761:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00010000:00010000:1.0:1787378165.611451:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.611468:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.611487:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.611493:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378165.611497:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.611504:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.611520:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9eeb97cb4c00) 00010000:00010000:1.0:1787378165.611523:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378165.611527:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.611533:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04200/0xdd3c5462d7852dca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378165.616423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378165.616499:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604540928 00000100:00100000:2.0:1787378165.616509:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604540928 00000100:00100000:2.0:1787378165.616569:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1787378165.616580:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:9677:x1874201604540928:12345-192.168.203.22@tcp:36:touch.500 00010000:00010000:2.0:1787378165.616641:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378165.616668:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852dd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6de8 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.616688:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eeb97cb4700) 00010000:00010000:2.0:1787378165.616698:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378165.616775:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.616788:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.616797:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378165.616948:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b306ef1 reply state 00000000aac9c6f6 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378165.616957:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378165.617061:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:9677:x1874201604540928:12345-192.168.203.22@tcp:36:touch.500 Request processed in 482us (647us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787378165.617082:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1787378165.627549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378165.627799:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604541056 00000100:00100000:1.0:1787378165.627817:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604541056 00000100:00100000:1.0:1787378165.627873:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1787378165.627883:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:9677:x1874201604541056:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:1.0:1787378165.627909:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378165.627930:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6def expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.628002:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6def expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.628027:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6def expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.628047:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eeba261ed00) 00010000:00010000:1.0:1787378165.628050:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378165.628054:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547c00, rc 0) 00000100:00100000:1.0:1787378165.628305:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:9677:x1874201604541056:12345-192.168.203.22@tcp:101:touch.500 Request processed in 422us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378165.628312:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00010000:00010000:2.0:1787378165.629123:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.629134:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.629142:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.629147:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378165.629152:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.629160:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.629173:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eeba261ed00) 00010000:00010000:2.0:1787378165.629176:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378165.629180:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.629186:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7852ddf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378165.651542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.654015:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604541184 00000100:00100000:3.0:1787378165.654030:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604541184 00000100:00100000:3.0:1787378165.654094:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1787378165.654102:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874201604541184:12345-192.168.203.22@tcp:8:touch.500 00010000:00080000:3.0:1787378165.654136:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1787378165.654170:0:6588:0:(genops.c:1406:class_connect()) connect: client 3ca7eed4-13a1-4f52-9d12-97b20fe7905e, cookie 0xdd3c5462d7852ded 00002000:00100000:3.0:1787378165.654183:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ca7eed4-13a1-4f52-9d12-97b20fe7905e/ffff9eeb84423800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787378165.654206:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787378165.654462:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787378165.654505:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9eeb84426000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787378165.654586:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2352:x1874201604541184:12345-192.168.203.22@tcp:8:touch.500 Request processed in 483us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378165.654594:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1787378165.660571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.661415:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604541312 00000100:00100000:3.0:1787378165.661427:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604541312 00000100:00100000:3.0:1787378165.661529:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1787378165.661541:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:0:x1874201604541312:12345-192.168.203.22@tcp:2:touch.500 00000100:00080000:0.0:1787378165.661976:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787378165.727203:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787378165.740658:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1787378165.740674:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000100:00100000:3.0:1787378165.740866:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:0:x1874201604541312:12345-192.168.203.22@tcp:2:touch.500 Request processed in 79321us (80298us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787378165.740877:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1787378165.743857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378165.743956:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604541568 00000100:00100000:1.0:1787378165.743966:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604541568 00000100:00100000:1.0:1787378165.744040:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:1.0:1787378165.744062:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:9677:x1874201604541568:12345-192.168.203.22@tcp:35:touch.500 00000100:00100000:1.0:1787378165.744426:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:9677:x1874201604541568:12345-192.168.203.22@tcp:35:touch.500 Request processed in 377us (578us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787378165.744434:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:1.0:1787378165.765011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.765098:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604541696 00000100:00100000:3.0:1787378165.765120:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604541696 00000100:00100000:2.0:1787378165.765586:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1787378165.765597:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:9678:x1874201604541696:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:2.0:1787378165.765634:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378165.765656:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6df6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.765763:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852dfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.765778:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.765793:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378165.765854:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787378165.765858:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378165.766536:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.766572:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6df6 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.766592:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852dfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6df6 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.766601:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:2.0:1787378165.766604:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378165.766608:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7c00, rc 0) 00000100:00100000:2.0:1787378165.766841:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:9678:x1874201604541696:12345-192.168.203.22@tcp:101:rm.0 Request processed in 1245us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378165.766850:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1787378165.777463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378165.778945:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604541952 00000100:00100000:1.0:1787378165.778958:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604541952 00000100:00100000:1.0:1787378165.779029:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:1.0:1787378165.779040:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:9678:x1874201604541952:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:1.0:1787378165.779060:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378165.779081:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6dfd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378165.779197:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787378165.779354:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dfd expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.779369:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:1.0:1787378165.779372:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787378165.779377:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dfd expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.779390:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546800, rc 0) 00000100:00100000:1.0:1787378165.779449:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:9678:x1874201604541952:12345-192.168.203.22@tcp:101:rm.0 Request processed in 411us (1994us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787378165.779456:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1787378165.787304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.787446:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604542080 00000100:00100000:3.0:1787378165.787456:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604542080 00000100:00100000:3.0:1787378165.787521:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:3.0:1787378165.787532:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:9678:x1874201604542080:12345-192.168.203.22@tcp:37:rm.0 00000100:00100000:3.0:1787378165.803107:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:9678:x1874201604542080:12345-192.168.203.22@tcp:37:rm.0 Request processed in 15567us (15803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378165.803122:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1787378165.815501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378165.815676:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604542336 00000100:00100000:1.0:1787378165.815685:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604542336 00000100:00100000:1.0:1787378165.815784:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1787378165.815795:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:9678:x1874201604542336:12345-192.168.203.22@tcp:35:rm.0 00000100:00100000:1.0:1787378165.816049:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:9678:x1874201604542336:12345-192.168.203.22@tcp:35:rm.0 Request processed in 255us (556us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787378165.816057:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1787378165.822233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378165.823243:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604542592 00000100:00100000:2.0:1787378165.823256:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604542592 00000100:00100000:2.0:1787378165.823341:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:2.0:1787378165.823352:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:9678:x1874201604542592:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:2.0:1787378165.823377:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378165.823397:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e04 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.823526:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852e17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.823543:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852e17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.823554:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852e17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378165.823565:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787378165.823711:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e04 expref: 17 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.824078:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852e17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e04 expref: 16 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.824087:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:2.0:1787378165.824089:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787378165.824092:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6c00, rc 0) 00000100:00100000:2.0:1787378165.824275:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:9678:x1874201604542592:12345-192.168.203.22@tcp:101:rm.0 Request processed in 917us (2043us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787378165.824299:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1787378165.833700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378165.835011:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604542720 00000100:00100000:1.0:1787378165.835024:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604542720 00000100:00100000:1.0:1787378165.835094:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787378165.835105:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:9678:x1874201604542720:12345-192.168.203.22@tcp:41:rm.0 00000004:00000024:1.0:1787378165.835165:0:5790:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787378165.835233:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:9678:x1874201604542720:12345-192.168.203.22@tcp:41:rm.0 Request processed in 130us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378165.835241:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:2.0:1787378165.838987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378165.839407:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604542848 00000100:00100000:3.0:1787378165.839419:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604542848 00000100:00100000:3.0:1787378165.839484:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1787378165.839495:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:9678:x1874201604542848:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:3.0:1787378165.839516:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378165.839537:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485c00/0xdd3c5462d7852e25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e0b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.839854:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.839977:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.839991:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840008:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840015:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840022:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840129:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852e3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840139:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840145:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378165.840172:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787378165.840177:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378165.840197:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840218:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840227:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840233:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840238:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840244:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.840248:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.840256:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841385:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:3.0:1787378165.841389:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378165.841394:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841401:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485200/0xdd3c5462d7852e2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841417:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841424:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841440:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841445:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.841448:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841455:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841463:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9eeb97cb4300) 00010000:00010000:3.0:1787378165.841465:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378165.841467:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841484:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485400/0xdd3c5462d7852e33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841525:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81485c00/0xdd3c5462d7852e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e0b expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841538:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e0b expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.841545:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eeba261ed00) 00010000:00010000:3.0:1787378165.841546:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378165.841549:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04000, rc 0) 00000100:00100000:0.0:1787378165.842024:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:9678:x1874201604542848:12345-192.168.203.22@tcp:101:rm.0 Request processed in 2528us (3042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378165.842047:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1787378165.845881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378165.846004:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604543104 00000100:00100000:1.0:1787378165.846014:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604543104 00000100:00100000:1.0:1787378165.846077:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:1.0:1787378165.846086:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:9678:x1874201604543104:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:1.0:1787378165.846140:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787378165.846167:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852e3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e0b expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846191:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6def expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846222:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eeba261ed00) 00010000:00010000:1.0:1787378165.846240:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852dfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6df6 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846249:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:1.0:1787378165.846252:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787378165.846344:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846357:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846367:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846381:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846387:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846392:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846515:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846525:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.846542:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787378165.849962:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787378165.849980:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302112259963ns, next at 303112256124ns, rc = 0 00010000:00010000:0.0:1787378165.850060:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850075:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850085:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850093:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850099:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850104:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850170:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378165.850195:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850202:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850208:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850226:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378165.850231:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850238:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850251:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eeb85524c00) 00010000:00010000:0.0:1787378165.850255:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787378165.850275:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850282:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7852e4f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850301:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850308:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850314:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850318:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378165.850321:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850326:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850344:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:0.0:1787378165.850346:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378165.850349:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378165.850354:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546800/0xdd3c5462d7852e41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378165.850364:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e861c8a reply state 00000000836eb9c5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378165.850373:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787378165.850461:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:9678:x1874201604543104:12345-192.168.203.22@tcp:36:rm.0 Request processed in 4372us (4596us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787378165.850478:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00010000:00010000:3.0:1787378165.852989:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.853020:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.853026:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.853032:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.853036:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.853043:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.853056:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9eeb85524000) 00010000:00010000:3.0:1787378165.853059:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378165.853063:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.853069:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852e48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.853195:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378165.853202:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.853208:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a400 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378165.853211:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.853217:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.853226:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eeb85524c00) 00010000:00010000:1.0:1787378165.853229:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787378165.853231:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.853236:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7852e56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378165.853248:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378165.853249:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378165.853251:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378165.856314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378165.857857:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604543360 00000100:00100000:1.0:1787378165.857879:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604543360 00000100:00100000:1.0:1787378165.857939:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787378165.857949:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:9678:x1874201604543360:12345-192.168.203.22@tcp:35:rm.0 00000100:00100000:1.0:1787378165.858213:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:9678:x1874201604543360:12345-192.168.203.22@tcp:35:rm.0 Request processed in 265us (1907us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787378165.858235:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1787378165.861940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378165.862162:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604543616 00000100:00100000:2.0:1787378165.862172:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604543616 00000100:00100000:2.0:1787378165.862229:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:2.0:1787378165.862239:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:9678:x1874201604543616:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:2.0:1787378165.862315:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787378165.862342:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6c00/0xdd3c5462d7852e17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e04 expref: 16 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.862362:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852db5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6de1 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.862373:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:2.0:1787378165.862389:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852d76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dd3 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.862398:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:2.0:1787378165.862404:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378165.862427:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.862438:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.862446:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.862488:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.862496:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.862503:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.863127:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.863138:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.863144:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378165.864546:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787378165.864565:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864640:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864647:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864652:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378165.864656:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864674:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864686:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:2.0:1787378165.864688:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787378165.864692:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864698:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7000/0xdd3c5462d7852e6b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864806:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864813:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864819:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864824:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378165.864827:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864832:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864839:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261e700) 00010000:00010000:2.0:1787378165.864841:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378165.864844:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378165.864858:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852e5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378165.865054:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a732b244 reply state 00000000b9300bfd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378165.865064:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378165.865504:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:9678:x1874201604543616:12345-192.168.203.22@tcp:36:rm.0 Request processed in 3263us (3569us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787378165.865513:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00010000:00010000:3.0:1787378165.875716:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.875777:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.875784:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.875790:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378165.875809:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.875818:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.875835:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eeba261e200) 00010000:00010000:3.0:1787378165.875838:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378165.875843:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378165.875849:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852e64 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378166.746063:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378166.811861:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626596096:0@lo:400:kworker.0 00000100:00100000:3.0:1787378166.811875:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626595840:0@lo:400:kworker.0 00000100:00100000:1.0:1787378166.811975:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626595712:0@lo:400:kworker.0 00000100:00100000:2.0:1787378166.812808:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626595968:0@lo:400:kworker.0 00000100:00100000:1.0:1787378166.815171:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378166.815172:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378166.815211:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378166.815277:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626596224:0@lo:400:kworker.0 00000100:00100000:1.0:1787378166.815313:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378166.815359:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626596352:0@lo:400:kworker.0 00000100:00100000:1.0:1787378166.815379:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626595840 00000100:00100000:1.0:1787378166.815388:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626595840 00000100:00100000:3.0:1787378166.815398:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626596224 00000100:00100000:3.0:1787378166.815403:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626596224 00000100:00100000:3.0:1787378166.815457:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787378166.815478:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626596224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378166.815550:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787378166.815557:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626595840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378166.815634:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626596224:12345-0@lo:400:kworker.0 Request processed in 168us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378166.815637:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378166.815647:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787378166.815672:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626595712 00000100:00100000:3.0:1787378166.815676:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626595712 00000100:00100000:3.0:1787378166.815698:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787378166.815702:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626595712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378166.815849:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626595712:12345-0@lo:400:kworker.0 Request processed in 145us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378166.815856:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1787378166.815880:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378166.815948:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626596096 00000100:00100000:3.0:1787378166.815952:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626596096 00000100:00100000:3.0:1787378166.815990:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626596352 00000100:00100000:3.0:1787378166.815994:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626596352 00000100:00100000:3.0:1787378166.816014:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787378166.816022:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626596096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378166.816051:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787378166.816065:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626596096:12345-0@lo:400:kworker.0 Request processed in 42us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378166.816066:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626596352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378166.816078:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787378166.816101:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787378166.816104:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787378166.816117:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626596352:12345-0@lo:400:kworker.0 Request processed in 57us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378166.816124:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787378166.816165:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c4700 x1874201626596352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378166.816193:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626596352:0@lo:400:kworker.0 00010000:00080000:0.0:1787378166.816224:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae6c5c00 x1874201626596096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378166.816233:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626596096:0@lo:400:kworker.0 00000100:00100000:0.0:1787378166.816268:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626595712:0@lo:400:kworker.0 00000100:00100000:0.0:1787378166.816279:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626596224:0@lo:400:kworker.0 00000100:00100000:1.0:1787378166.816501:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626595840:12345-0@lo:400:kworker.0 Request processed in 944us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378166.816509:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787378166.816578:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626595840:0@lo:400:kworker.0 00000100:00100000:2.0:1787378166.817504:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378166.818278:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626595968 00000100:00100000:3.0:1787378166.818289:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626595968 00000100:00100000:3.0:1787378166.818364:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787378166.818373:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626595968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378166.818459:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626595968:12345-0@lo:400:kworker.0 Request processed in 87us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378166.818476:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787378166.818752:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626595968:0@lo:400:kworker.0 00000100:00080000:0.0:1787378166.818838:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1787378167.323502:0:7945:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303585779976ns, next at 304585777464ns, rc = 0 00000100:00100000:1.0:1787378167.323535:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626596480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378167.323597:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378167.323666:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626596480 00000100:00100000:1.0:1787378167.323672:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626596480 00000100:00100000:1.0:1787378167.323739:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787378167.323749:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626596480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378167.323782:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378167.323822:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626596480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378167.323829:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787378167.323882:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbb1e1c00 x1874201626596480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378167.323898:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626596480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378167.325669:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378167.325688:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626596608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378167.325769:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378167.325816:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626596608 00000100:00100000:1.0:1787378167.325823:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626596608 00000100:00100000:1.0:1787378167.325861:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787378167.325868:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626596608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378167.325918:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378167.325955:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626596608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378167.325963:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787378167.325998:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbb1e1c00 x1874201626596608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378167.326014:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626596608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787378167.770050:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378168.800525:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378169.471538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378169.471584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378169.471696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378169.471756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378169.471892:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604543744 00000100:00100000:3.0:1787378169.471901:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604543744 00000100:00100000:3.0:1787378169.471958:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:3.0:1787378169.471967:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604543744:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378169.472034:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604543744:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378169.472036:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604544000 00000100:00100000:0.0:1787378169.472040:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604544000 00000100:00100000:3.0:1787378169.472054:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:0.0:1787378169.472076:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:0.0:1787378169.472082:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604544000:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378169.472111:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604544000:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378169.472117:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00080000:0.0:1787378169.472131:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378169.474204:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604543872 00000100:00100000:1.0:1787378169.474219:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604543872 00000100:00100000:3.0:1787378169.475827:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:3.0:1787378169.475845:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:2355:x1874201604543872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:0.0:1787378169.475929:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378169.475940:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:2355:x1874201604543872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 102us (4412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378169.475948:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:1.0:1787378169.476034:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604544128 00000100:00100000:1.0:1787378169.476041:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604544128 00000100:00100000:1.0:1787378169.476241:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:1.0:1787378169.476256:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604544128:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378169.476291:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604544128:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 43us (4706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378169.476867:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00080000:0.0:1787378169.478631:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787378169.842674:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787378170.445932:0:11468:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787378170.842142:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787378171.074445:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787378171.074457:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1787378171.074480:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787378171.074485:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1787378171.074495:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1787378171.075033:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626596736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787378171.075104:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378171.080472:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626596736 00000100:00100000:3.0:1787378171.080485:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626596736 00000100:00100000:3.0:1787378171.080570:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787378171.080579:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626596736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787378171.080609:0:6586:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1787378171.080645:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8939f5, atime: 0x6a8939f5, ctime: 0x6a8939f5, blocks: 0x1 00010000:00010000:3.0:1787378171.080655:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378171.080670:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1787378171.080674:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378171.080680:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378171.080886:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378171.080899:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378171.080920:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378171.081064:0:6586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787378171.083521:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626596736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2937us (8410us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787378171.083533:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787378171.083644:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787378171.084904:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eebbb1e1c00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787378171.084915:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626596736:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787378171.086017:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787378171.086030:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378171.086044:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378171.086050:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378171.086075:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378171.086102:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378171.086110:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045524789/0xdd3c5462d7852e72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378171.086135:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378171.086137:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378171.086139:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378171.868462:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378171.929981:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626596992:0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.930065:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378171.930117:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626597504:0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.930144:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378171.930176:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378171.930182:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626597120:0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.930203:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378171.930239:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626596992 00000100:00100000:2.0:1787378171.930247:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626596992 00000100:00100000:2.0:1787378171.930287:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626597120 00000100:00100000:2.0:1787378171.930290:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626597120 00000100:00100000:2.0:1787378171.930331:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787378171.930340:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626596992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.930397:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626596992:12345-0@lo:400:kworker.0 Request processed in 57us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378171.930404:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787378171.930421:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787378171.930427:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626597120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.930466:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626597120:12345-0@lo:400:kworker.0 Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378171.930471:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787378171.930488:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626597504 00000100:00100000:2.0:1787378171.930491:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626597504 00000100:00100000:2.0:1787378171.930517:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787378171.930523:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626597504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.930553:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626597504:12345-0@lo:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378171.930558:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787378171.930579:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378171.930612:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626597120:0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.930623:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626596992:0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.930631:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626597504:0@lo:400:kworker.0 00000100:00100000:0.0:1787378171.930701:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626596864:0@lo:400:kworker.0 00000100:00100000:0.0:1787378171.930763:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378171.930789:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626597376:0@lo:400:kworker.0 00000100:00100000:0.0:1787378171.930812:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378171.930829:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787378171.930834:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626597248:0@lo:400:kworker.0 00000100:00100000:0.0:1787378171.930853:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378171.931519:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626596864 00000100:00100000:2.0:1787378171.931526:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626596864 00000100:00100000:2.0:1787378171.931564:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787378171.931571:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626596864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.931626:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626596864:12345-0@lo:400:kworker.0 Request processed in 55us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378171.931643:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787378171.931673:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626597248 00000100:00100000:2.0:1787378171.931677:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626597248 00000100:00100000:2.0:1787378171.931738:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787378171.931745:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626597248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.931777:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626597248:12345-0@lo:400:kworker.0 Request processed in 33us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378171.931782:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787378171.931799:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378171.931807:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626597376 00000100:00100000:2.0:1787378171.931811:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626597376 00000100:00100000:2.0:1787378171.931838:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787378171.931843:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626597376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378171.931873:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626597376:12345-0@lo:400:kworker.0 Request processed in 30us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378171.931879:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787378171.931893:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787378171.932022:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbf637480 x1874201626597248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378171.932035:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626597248:0@lo:400:kworker.0 00000100:00100000:1.0:1787378171.932045:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626596864:0@lo:400:kworker.0 00000100:00100000:1.0:1787378171.932054:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626597376:0@lo:400:kworker.0 00000020:00000080:0.0:1787378172.023992:0:11517:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe4f3a0b70 00000020:00000080:0.0:1787378172.024007:0:11517:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787378172.024012:0:11517:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787378172.024019:0:11517:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4f3a2e00 20000000:00000080:0.0:1787378172.024025:0:11517:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eebae311000 uarg=0000000000000000 20000000:01000000:0.0:1787378172.024068:0:11517:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787378172.024075:0:11517:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787378172.024080:0:11517:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787378172.025615:0:11518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787378172.025888:0:11517:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787378172.034329:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787378172.034388:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787378172.034456:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787378172.034480:0:11517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787378172.034500:0:11517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034518:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034537:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034544:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034554:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034561:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034569:0:11517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034609:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034624:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 12 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.034639:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84558000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626597632:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378172.034776:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034785:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 12 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.034794:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626597760:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378172.034830:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.034839:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 18 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.034848:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626597888:0@lo:104: 00000100:00100000:2.0:1787378172.034882:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787378172.039136:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.039153:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 18 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.039167:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84558e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626598016:0@lo:104: 00000100:00100000:2.0:1787378172.039218:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378172.047028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378172.047053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378172.047075:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604544384 00000100:00100000:0.0:1787378172.047083:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604544384 00010000:00010000:0.0:1787378172.047120:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 13 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378172.047148:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604544256 00000100:00100000:0.0:1787378172.047151:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604544256 00010000:00010000:0.0:1787378172.047163:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 14 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378172.047184:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1787378172.047193:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+14:2353:x1874201604544384:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378172.047222:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378172.047228:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 14 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.047240:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 14 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.047258:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378172.047307:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+14:2353:x1874201604544384:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 114us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378172.047314:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1787378172.047333:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787378172.047338:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+13:2353:x1874201604544256:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378172.047346:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378172.047351:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 13 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.047361:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 13 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.047370:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378172.047389:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+13:2353:x1874201604544256:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378172.047395:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00010000:00010000:2.0:1787378172.052293:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.052311:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 18 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.052327:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb8455aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626598144:0@lo:104: 00000100:00100000:2.0:1787378172.052378:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378172.057519:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626597888 00000100:00100000:3.0:1787378172.057534:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626597888 00000100:00100000:3.0:1787378172.057592:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626598016 00000100:00100000:3.0:1787378172.057595:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626598016 00000100:00100000:3.0:1787378172.057614:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787378172.057623:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:11517:x1874201626597888:12345-0@lo:104: 00010000:00010000:3.0:1787378172.057639:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.057753:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787378172.057759:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+4:11517:x1874201626597888:12345-0@lo:104: Request processed in 137us (22877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378172.057766:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787378172.057785:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787378172.057792:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:11517:x1874201626598016:12345-0@lo:104: 00010000:00010000:3.0:1787378172.057817:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.057857:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787378172.057862:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:11517:x1874201626598016:12345-0@lo:104: Request processed in 71us (18644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378172.057868:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787378172.057888:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787378172.057893:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.057899:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a200 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378172.057903:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.057910:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378172.057916:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378172.057921:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787378172.057969:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.057976:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787378172.057996:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058003:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128a200/0xdd3c5462d7852d30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058022:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378172.058026:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058031:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05e00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378172.058034:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058041:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378172.058047:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378172.058052:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787378172.058068:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058074:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787378172.058090:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058097:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852d22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d29 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058105:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378172.058107:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378172.058108:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378172.058142:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626598272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787378172.058187:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378172.058227:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626598400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787378172.058251:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378172.058280:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626598272 00000100:00100000:3.0:1787378172.058285:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626598272 00010000:00010000:3.0:1787378172.058303:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 19 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378172.058323:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626598400 00000100:00100000:3.0:1787378172.058326:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626598400 00010000:00010000:3.0:1787378172.058336:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 20 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378172.058352:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787378172.058358:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3312:x1874201626598272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787378172.058367:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378172.058373:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 20 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058383:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 20 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058399:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378172.058425:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+20:3312:x1874201626598272:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378172.058444:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787378172.058482:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787378172.058488:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626598400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787378172.058495:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378172.058506:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 19 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058514:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 19 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.058523:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378172.058550:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626598400:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378172.058556:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787378172.058594:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626598272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787378172.058616:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626598400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378172.058761:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378172.059616:0:11517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee180 going to sleep for 11 seconds 00010000:00010000:2.0:1787378172.059644:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd05400/0xdd3c5462d7852d45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dc5 expref: 12 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.059658:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84558000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626597632:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378172.059671:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd05600/0xdd3c5462d7852d3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6dbe expref: 11 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.059694:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626597760:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378172.059707:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7852d37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852d30 expref: 18 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.059715:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626597888:0@lo:104: 00010000:00010000:2.0:1787378172.059746:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81546200/0xdd3c5462d7852d29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852d22 expref: 17 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.059754:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84558e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626598016:0@lo:104: 00000100:00100000:3.0:1787378172.059830:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787378172.059843:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626598144 00000100:00100000:3.0:1787378172.059848:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626598144 00000100:00100000:3.0:1787378172.059878:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787378172.059884:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:11517:x1874201626598144:12345-0@lo:104: 00010000:00010000:3.0:1787378172.059895:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.060097:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb8455aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1874201626598144:0@lo:104: 00010000:00010000:2.0:1787378172.060124:0:11517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378172.060160:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787378172.060167:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+3:11517:x1874201626598144:12345-0@lo:104: Request processed in 282us (7789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378172.060174:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787378172.062049:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378172.062061:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378172.062072:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6600 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378172.062076:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378172.062085:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378172.062092:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378172.062098:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787378172.062149:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378172.062156:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787378172.062229:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626598528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378172.062290:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378172.063084:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626598528 00000100:00100000:0.0:1787378172.063093:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626598528 00010000:00010000:0.0:1787378172.063138:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 17 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378172.063185:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787378172.063194:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:3314:x1874201626598528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378172.063208:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378172.063213:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 17 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063224:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 17 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063238:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128ae00/0xdd3c5462d7852d1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7852d14 expref: 17 pid: 5786 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063253:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063261:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063276:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063282:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063289:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063295:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063311:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378172.063315:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063323:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063340:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378172.063351:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787378172.064468:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378172.064481:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebc21c6600/0xdd3c5462d7852d14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7852d1b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378172.064502:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378172.064504:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378172.064507:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378172.068316:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3314:x1874201626598528:12345-0@lo:103:ldlm_bl.0 Request processed in 5112us (6014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378172.068329:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787378172.068454:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626598528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378172.068495:0:11517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.068506:0:11517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378172.068512:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e79 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378172.442106:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626598656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378172.442196:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378172.442286:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378172.442293:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626598784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378172.442317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378172.442397:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626598656 00000100:00100000:3.0:1787378172.442405:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626598656 00000100:00100000:3.0:1787378172.442455:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626598784 00000100:00100000:3.0:1787378172.442458:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626598784 00000100:00100000:3.0:1787378172.442476:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787378172.442492:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626598656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378172.442526:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378172.442587:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626598656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378172.442594:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787378172.442615:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787378172.442624:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626598784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787378172.442646:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378172.442675:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626598784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378172.442681:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787378172.442768:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626598784:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787378172.442780:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbb1e3800 x1874201626598656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378172.442792:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626598656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787378172.890775:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787378173.466059:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787378173.466067:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebbb181000 from 7 10000000:01000000:3.0:1787378173.466072:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787378173.466122:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378173.466135:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378173.466146:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378173.466171:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626598912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787378173.466240:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378173.467487:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbac580c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378173.467574:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626598912 00000100:00100000:2.0:1787378173.467583:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626598912 00000100:00100000:2.0:1787378173.467669:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787378173.467678:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:5788:x1874201626598912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378173.467693:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378173.467711:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852e80 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378173.467771:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852e80 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378173.467783:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852e80 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378173.467792:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6c00, rc 0) 00000100:00100000:2.0:1787378173.467847:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626598912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378173.467853:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787378173.468009:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626598912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378173.468026:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378173.468035:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378173.468098:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378173.468134:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378173.468156:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378173.468286:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626599040 00000100:00100000:0.0:1787378173.468292:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626599040 00000100:00100000:0.0:1787378173.468329:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787378173.468336:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626599040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378173.468610:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626599040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.468619:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787378173.468632:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.468675:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.468713:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.468934:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378173.473987:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626599168 00000100:00100000:0.0:1787378173.474002:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626599168 00000100:00100000:0.0:1787378173.474060:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787378173.474070:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626599168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787378173.474320:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626599168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (5605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.474338:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787378173.474537:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.476143:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11530:1874201626599296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378173.476227:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.476259:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1787378173.476412:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626599296 00000100:00100000:0.0:1787378173.476428:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626599296 00000100:00100000:0.0:1787378173.476459:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787378173.476467:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:11530:x1874201626599296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378173.476694:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:11530:x1874201626599296:12345-0@lo:502:llog_process_th.0 Request processed in 224us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.476701:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787378173.477084:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11530:1874201626599296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378173.477114:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378173.477123:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378173.477126:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787378173.477132:0:11530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eebbb181000 00000020:00000080:2.0:1787378173.477135:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787378173.477279:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11530:1874201626599424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378173.477321:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.477355:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1787378173.478368:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626599424 00000100:00100000:0.0:1787378173.478380:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626599424 00000100:00100000:0.0:1787378173.478442:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787378173.478452:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:11530:x1874201626599424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787378173.478681:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:11530:x1874201626599424:12345-0@lo:502:llog_process_th.0 Request processed in 229us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.478708:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787378173.479920:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11530:1874201626599424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378173.479957:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378173.479965:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378173.479967:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787378173.479971:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787378173.480281:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787378173.480305:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787378173.480317:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.480329:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378173.480339:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787378173.480342:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb88344000 from 7 10000000:01000000:0.0:1787378173.480345:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787378173.480376:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.480394:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.480404:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378173.480444:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787378173.480495:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378173.480537:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89913600 going to sleep for 11 seconds 00000100:00100000:1.0:1787378173.481283:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626599552 00000100:00100000:1.0:1787378173.481291:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626599552 00000100:00100000:1.0:1787378173.481344:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787378173.481354:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:5788:x1874201626599552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378173.481367:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378173.481382:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852e95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852e8e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378173.481405:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852e95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852e8e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378173.481445:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852e95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852e8e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378173.481453:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546800, rc 0) 00000100:00100000:1.0:1787378173.481509:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626599552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378173.481516:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787378173.482247:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378173.482267:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378173.482289:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378173.482361:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.482398:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.482441:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1787378173.482869:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626599680 00000100:00100000:0.0:1787378173.482876:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626599680 00000100:00100000:0.0:1787378173.482922:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787378173.482930:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626599680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378173.483242:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626599680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.483250:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787378173.483348:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.483383:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.483432:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.483453:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1787378173.483498:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626599808 00000100:00100000:0.0:1787378173.483503:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626599808 00000100:00100000:0.0:1787378173.483602:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787378173.483609:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9e11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626599808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787378173.483800:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9e11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626599808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.483807:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787378173.494007:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626599808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.494286:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11532:1874201626599936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378173.494359:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.494395:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626599936 00000100:00100000:2.0:1787378173.494402:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626599936 00000100:00100000:2.0:1787378173.494449:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787378173.494457:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:11532:x1874201626599936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378173.494688:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:11532:x1874201626599936:12345-0@lo:502:llog_process_th.0 Request processed in 231us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378173.494696:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787378173.495236:0:11532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378173.495258:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11532:1874201626599936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378173.495285:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378173.495300:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378173.495303:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787378173.495310:0:11532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eeb88344000 00000020:00000080:2.0:1787378173.495312:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787378173.495389:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11532:1874201626600064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378173.495436:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.495461:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626600064 00000100:00100000:2.0:1787378173.495465:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626600064 00000100:00100000:2.0:1787378173.495501:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787378173.495508:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:11532:x1874201626600064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378173.495637:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:11532:x1874201626600064:12345-0@lo:502:llog_process_th.0 Request processed in 129us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378173.495644:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787378173.495673:0:11532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378173.495684:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11532:1874201626600064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378173.495704:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378173.495709:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378173.495710:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787378173.495713:0:11532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787378173.496979:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787378173.497000:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787378173.497011:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378173.497025:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378173.497035:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787378173.497049:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb8a31b800 from 7 10000000:01000000:2.0:1787378173.497053:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787378173.497082:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378173.497090:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378173.497101:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378173.497120:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626600192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.497163:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378173.508740:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626600192 00000100:00100000:0.0:1787378173.508766:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626600192 00000100:00100000:0.0:1787378173.508851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378173.508902:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604544512 00000100:00100000:0.0:1787378173.508906:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604544512 00000100:00100000:0.0:1787378173.508922:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787378173.508930:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:5788:x1874201626600192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787378173.508948:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378173.508967:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128b400/0xdd3c5462d7852ea3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7852e9c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.508995:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128b400/0xdd3c5462d7852ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7852e9c expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.509007:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128b400/0xdd3c5462d7852ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7852e9c expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.509017:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b400, rc 0) 00000100:00100000:0.0:1787378173.509065:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626600192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (11902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.509072:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787378173.509113:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 263 00000100:00100000:0.0:1787378173.509120:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+11:5570:x1874201604544512:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787378173.509126:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378173.509133:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128a400/0xdd3c5462d7852eaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e12 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.509145:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128a400/0xdd3c5462d7852eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e12 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.509153:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128a400/0xdd3c5462d7852eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e12 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378173.509169:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a400, rc 0) 00000100:00100000:0.0:1787378173.509209:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604544512:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.509216:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 263 00000100:00100000:2.0:1787378173.509716:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378173.509888:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626600192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378173.509908:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378173.509919:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378173.509989:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626600320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.510028:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.510050:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378173.510081:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626600320 00000100:00100000:2.0:1787378173.510085:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626600320 00000100:00100000:2.0:1787378173.510177:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787378173.510185:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626600320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.510446:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626600320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378173.510461:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787378173.510496:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626600320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.510522:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626600448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.510559:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.510572:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378173.510583:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626600448 00000100:00100000:2.0:1787378173.510586:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626600448 00000100:00100000:2.0:1787378173.510602:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787378173.510608:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626600448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378173.513499:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:5788:x1874201626600448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2883us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378173.513512:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787378173.514242:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:5788:1874201626600448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378173.520392:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11533:1874201626600576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378173.520489:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378173.520537:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbac58840 going to sleep for 11 seconds 00000100:00100000:2.0:1787378173.520589:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626600576 00000100:00100000:2.0:1787378173.520597:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626600576 00000100:00100000:2.0:1787378173.520659:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787378173.520667:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:11533:x1874201626600576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378173.520925:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:11533:x1874201626600576:12345-0@lo:502:llog_process_th.0 Request processed in 258us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378173.520933:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787378173.520987:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11533:1874201626600576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378173.521013:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378173.521022:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378173.521025:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787378173.521032:0:11533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eeb8a31b800 00000020:00000080:2.0:1787378173.521035:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787378173.521565:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84558000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11533:1874201626600704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378173.521607:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378173.521634:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee300 going to sleep for 11 seconds 00000100:00100000:3.0:1787378173.521701:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626600704 00000100:00100000:3.0:1787378173.521707:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626600704 00000100:00100000:3.0:1787378173.521768:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787378173.521776:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:11533:x1874201626600704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378173.521915:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:11533:x1874201626600704:12345-0@lo:502:llog_process_th.0 Request processed in 139us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378173.521921:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787378173.522879:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84558000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:11533:1874201626600704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378173.522906:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378173.522912:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378173.522915:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787378173.522919:0:11533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787378173.523277:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787378173.523294:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787378173.523305:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378173.523316:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378173.523455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378173.523485:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604544640 00000100:00100000:0.0:1787378173.523490:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604544640 00000100:00100000:0.0:1787378173.523528:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 268 00000100:00100000:0.0:1787378173.523536:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604544640:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378173.524362:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604544640:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 824us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.524372:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 268 00000100:00100000:1.0:1787378173.529163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378173.529200:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604544768 00000100:00100000:1.0:1787378173.529209:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604544768 00000100:00100000:1.0:1787378173.529252:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 269 00000100:00100000:1.0:1787378173.529262:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604544768:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787378173.529474:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604544768:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 212us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378173.529483:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 269 00000100:00100000:3.0:1787378173.536760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378173.537164:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604544896 00000100:00100000:0.0:1787378173.537177:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604544896 00000100:00100000:0.0:1787378173.537237:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 270 00000100:00100000:0.0:1787378173.537247:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+12:9949:x1874201604544896:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787378173.537501:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+12:9949:x1874201604544896:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 254us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378173.537509:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 270 00000040:00080000:1.0:1787378173.538080:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787378173.548136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378173.548292:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604545024 00000100:00100000:2.0:1787378173.548302:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604545024 00000100:00100000:2.0:1787378173.548356:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 271 00000100:00100000:2.0:1787378173.548366:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+12:9949:x1874201604545024:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787378173.549210:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+12:9949:x1874201604545024:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 842us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378173.549221:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 271 00000100:00100000:1.0:1787378173.571064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378173.571278:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604545152 00000100:00100000:3.0:1787378173.571288:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604545152 00000100:00100000:3.0:1787378173.571343:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 272 00000100:00100000:3.0:1787378173.571353:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+12:5570:x1874201604545152:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378173.571372:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378173.571390:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852eb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e19 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378173.571427:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e19 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378173.571457:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e19 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378173.571466:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04200, rc 0) 00000100:00100000:3.0:1787378173.571526:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604545152:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 173us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378173.571533:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 272 00000100:00100000:0.0:1787378173.587858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378173.588790:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604545280 00000100:00100000:1.0:1787378173.588801:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604545280 00000100:00100000:1.0:1787378173.588850:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 273 00000100:00100000:1.0:1787378173.588859:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604545280:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378173.589257:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604545280:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 397us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378173.589276:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 273 00000100:00100000:1.0:1787378173.596446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378173.596514:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604545408 00000100:00100000:3.0:1787378173.596524:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604545408 00000100:00100000:3.0:1787378173.596576:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 274 00000100:00100000:3.0:1787378173.596586:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604545408:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378173.596843:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:5570:x1874201604545408:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 256us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378173.596851:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 274 00000100:00100000:1.0:1787378173.604324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378173.605088:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604545536 00000100:00100000:3.0:1787378173.605100:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604545536 00000100:00100000:3.0:1787378173.605178:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 275 00000100:00100000:3.0:1787378173.605188:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8670b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:9952:x1874201604545536:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787378173.605440:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8670b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:9952:x1874201604545536:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 252us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378173.605451:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 275 00000100:00100000:0.0:1787378173.613167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378173.613458:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604545664 00000100:00100000:1.0:1787378173.613468:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604545664 00000100:00100000:1.0:1787378173.613532:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 276 00000100:00100000:1.0:1787378173.613543:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:9952:x1874201604545664:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787378173.613999:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:9952:x1874201604545664:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 457us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378173.614008:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 276 00010000:00010000:1.0:1787378173.914174:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787378174.556432:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787378174.591577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378174.591616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378174.591656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378174.591904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378174.591974:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604545792 00000100:00100000:1.0:1787378174.591984:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604545792 00000100:00100000:1.0:1787378174.592039:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 277 00000100:00100000:1.0:1787378174.592048:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604545792:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378174.592135:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604545792:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 87us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378174.592143:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 277 00000100:00100000:2.0:1787378174.592347:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604546048 00000100:00100000:2.0:1787378174.592352:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604546048 00000100:00100000:2.0:1787378174.592403:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:2.0:1787378174.592421:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604546048:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378174.592462:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604546048:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 51us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378174.592468:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00080000:1.0:1787378174.596709:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787378174.605574:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604545920 00000100:00100000:0.0:1787378174.605589:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604545920 00000100:00100000:0.0:1787378174.605702:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604546176 00000100:00100000:0.0:1787378174.605706:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604546176 00000100:00080000:1.0:1787378174.605898:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378174.606027:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:0.0:1787378174.606040:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604545920:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378174.606131:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604545920:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 93us (14473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378174.609013:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:3.0:1787378174.609040:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604546176:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378174.609141:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604546176:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 114us (17237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378174.609149:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:0.0:1787378174.610311:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00010000:00010000:1.0:1787378174.937911:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378175.967641:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787378176.121810:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1787378176.985868:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378177.051475:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626601216:0@lo:400:kworker.0 00000100:00100000:1.0:1787378177.051548:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378177.051628:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787378177.051635:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626601088:0@lo:400:kworker.0 00000100:00100000:1.0:1787378177.051703:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378177.051753:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626601216 00000100:00100000:1.0:1787378177.051762:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626601216 00000100:00100000:1.0:1787378177.051814:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787378177.051825:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626601216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.051942:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626600960:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.051972:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378177.051990:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626601472:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052020:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378177.052043:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787378177.052049:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626600832:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052088:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378177.052110:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626601344:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052130:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378177.052153:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626601472 00000100:00100000:2.0:1787378177.052157:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626601472 00000100:00100000:2.0:1787378177.052186:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787378177.052192:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626601472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052237:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626601472:12345-0@lo:400:kworker.0 Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378177.052244:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787378177.052266:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626601088 00000100:00100000:2.0:1787378177.052269:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626601088 00000100:00100000:2.0:1787378177.052296:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626600960 00000100:00100000:2.0:1787378177.052299:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626600960 00000100:00100000:2.0:1787378177.052310:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626601344 00000100:00100000:2.0:1787378177.052312:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626601344 00000100:00100000:2.0:1787378177.052325:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787378177.052331:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626601088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052364:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626601088:12345-0@lo:400:kworker.0 Request processed in 33us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378177.052369:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787378177.052380:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787378177.052386:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626600960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052423:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626600960:12345-0@lo:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378177.052436:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787378177.052448:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787378177.052453:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626601344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052478:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626601344:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378177.052484:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787378177.052527:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626601344:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052538:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626600960:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052545:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787378177.052550:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eebbb1e1c00, transno 4294967300 00000100:00100000:2.0:1787378177.052562:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626601472:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052589:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626601088:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052622:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626600832 00000100:00100000:2.0:1787378177.052626:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626600832 00000100:00100000:2.0:1787378177.052649:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787378177.052655:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626600832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.052684:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626600832:12345-0@lo:400:kworker.0 Request processed in 29us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378177.052690:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:2.0:1787378177.052712:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378177.052738:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378177.052741:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378177.052757:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626600832:0@lo:400:kworker.0 00000100:00100000:1.0:1787378177.053454:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626601216:12345-0@lo:400:kworker.0 Request processed in 1629us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378177.053462:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1787378177.054768:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbb1e1180 x1874201626601216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378177.054798:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626601216:0@lo:400:kworker.0 00000100:00100000:2.0:1787378177.562239:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787378177.562263:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626601600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378177.562331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378177.562450:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626601600 00000100:00100000:3.0:1787378177.562458:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626601600 00000100:00100000:3.0:1787378177.562514:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787378177.562524:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626601600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787378177.562567:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378177.562615:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626601600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378177.562622:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787378177.562670:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626601600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787378177.563173:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787378177.563186:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626601728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378177.563220:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378177.563306:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626601728 00000100:00100000:1.0:1787378177.563311:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626601728 00000100:00100000:1.0:1787378177.563347:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787378177.563354:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626601728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378177.563376:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378177.563430:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626601728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378177.563436:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787378177.563708:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbb1e0380 x1874201626601728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378177.563746:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626601728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787378178.011795:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378179.033926:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378179.712004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378179.712524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378179.712571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378179.712680:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604546304 00000100:00100000:1.0:1787378179.712694:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604546304 00000100:00100000:1.0:1787378179.712806:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 279 00000100:00100000:1.0:1787378179.712818:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604546304:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378179.712934:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604546304:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 117us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378179.712942:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 279 00000100:00100000:3.0:1787378179.713267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378179.713324:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604546560 00000100:00100000:2.0:1787378179.713329:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604546560 00000100:00100000:2.0:1787378179.713393:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:2.0:1787378179.713402:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604546560:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378179.713445:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604546560:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 45us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378179.713463:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00080000:1.0:1787378179.714308:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787378179.719131:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604546432 00000100:00100000:0.0:1787378179.719147:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604546432 00000100:00080000:1.0:1787378179.719300:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378179.720345:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604546688 00000100:00100000:0.0:1787378179.720357:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604546688 00000100:00100000:1.0:1787378179.720367:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:1.0:1787378179.720408:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604546432:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378179.720435:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:0.0:1787378179.720450:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604546688:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378179.720562:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604546432:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 176us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378179.720563:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604546688:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 112us (7291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378179.720589:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:0.0:1787378179.720603:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00080000:3.0:1787378179.721985:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787378180.057957:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378181.082278:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378182.106058:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378182.170683:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626601856:0@lo:400:kworker.0 00000100:00100000:1.0:1787378182.170686:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626602240:0@lo:400:kworker.0 00000100:00100000:1.0:1787378182.170852:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378182.170928:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787378182.170935:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626602112:0@lo:400:kworker.0 00000100:00100000:1.0:1787378182.170960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378182.171293:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378182.171357:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626602368:0@lo:400:kworker.0 00000100:00100000:1.0:1787378182.171567:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626601856 00000100:00100000:1.0:1787378182.171578:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626601856 00000100:00100000:1.0:1787378182.171652:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787378182.171663:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626601856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378182.171753:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626601856:12345-0@lo:400:kworker.0 Request processed in 91us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378182.171761:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787378182.171869:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378182.171946:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626601856:0@lo:400:kworker.0 00000100:00100000:2.0:1787378182.171954:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626601984:0@lo:400:kworker.0 00000100:00100000:3.0:1787378182.172012:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626602112 00000100:00100000:2.0:1787378182.172017:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378182.172021:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626602112 00000100:00100000:2.0:1787378182.172043:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626602496:0@lo:400:kworker.0 00000100:00100000:2.0:1787378182.172067:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378182.172110:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626602368 00000100:00100000:2.0:1787378182.172115:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626602368 00000100:00100000:2.0:1787378182.172160:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626601984 00000100:00100000:2.0:1787378182.172163:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626601984 00000100:00100000:2.0:1787378182.172178:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787378182.172186:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626602368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378182.172251:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626602368:12345-0@lo:400:kworker.0 Request processed in 64us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378182.172266:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787378182.172281:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787378182.172288:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626601984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378182.172306:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787378182.172315:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626602112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378182.172331:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626601984:12345-0@lo:400:kworker.0 Request processed in 42us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378182.172338:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787378182.172358:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626602112:12345-0@lo:400:kworker.0 Request processed in 44us (1396us total) trans 0 rc 0/0 00000100:00080000:2.0:1787378182.172359:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378182.172378:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787378182.172399:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626601984:0@lo:400:kworker.0 00000100:00100000:3.0:1787378182.172403:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626602240 00000100:00100000:3.0:1787378182.172409:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626602240 00000100:00080000:2.0:1787378182.172430:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787378182.172442:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626602496 00000100:00100000:3.0:1787378182.172445:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626602496 00000100:00100000:2.0:1787378182.172449:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787378182.172459:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626602240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378182.172471:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787378182.172480:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626602496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378182.172497:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626602240:12345-0@lo:400:kworker.0 Request processed in 38us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378182.172503:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787378182.172520:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626602496:12345-0@lo:400:kworker.0 Request processed in 41us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378182.172529:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787378182.172536:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787378182.172562:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626602368:0@lo:400:kworker.0 00000100:00100000:2.0:1787378182.172572:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626602496:0@lo:400:kworker.0 00000100:00100000:1.0:1787378182.172637:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626602112:0@lo:400:kworker.0 00010000:00080000:1.0:1787378182.172659:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbb1e1500 x1874201626602240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378182.172672:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626602240:0@lo:400:kworker.0 00000100:00100000:0.0:1787378182.682750:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626602624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787378182.682824:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378182.682948:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626602624 00000100:00100000:0.0:1787378182.682956:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626602624 00000100:00100000:0.0:1787378182.683017:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787378182.683027:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626602624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378182.683103:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378182.683369:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626602624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 333us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378182.683377:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787378182.683411:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626602752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378182.683441:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378182.683507:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626602624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378182.683639:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626602752 00000100:00100000:1.0:1787378182.683651:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626602752 00000100:00100000:1.0:1787378182.683777:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787378182.683786:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626602752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378182.683830:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378182.683876:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626602752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378182.683883:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787378182.684042:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50df100 x1874201626602752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378182.684056:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626602752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787378183.130076:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378184.154384:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787378184.794328:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787378184.828802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378184.828842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378184.828877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378184.828902:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378184.828926:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604546944 00000100:00100000:2.0:1787378184.828935:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604546944 00000100:00100000:2.0:1787378184.828988:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604547200 00000100:00100000:2.0:1787378184.828991:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604547200 00000100:00100000:2.0:1787378184.829014:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:2.0:1787378184.829036:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604546944:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378184.829110:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604546944:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378184.829118:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:2.0:1787378184.829135:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:2.0:1787378184.829142:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604547200:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378184.829176:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604547200:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378184.829183:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00080000:2.0:1787378184.829203:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378184.829388:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604546816 00000100:00100000:1.0:1787378184.829393:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604546816 00000100:00100000:1.0:1787378184.829430:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 281 00000100:00100000:1.0:1787378184.829437:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604546816:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378184.829465:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604546816:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378184.829471:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 281 00000100:00100000:3.0:1787378184.830068:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604547072 00000100:00100000:3.0:1787378184.830075:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604547072 00000100:00100000:3.0:1787378184.830136:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:3.0:1787378184.830145:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604547072:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378184.830182:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604547072:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378184.830214:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00080000:2.0:1787378184.830299:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787378185.177928:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378186.201890:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378187.227292:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378187.289929:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626602880:0@lo:400:kworker.0 00000100:00100000:1.0:1787378187.289976:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626603264:0@lo:400:kworker.0 00000100:00100000:3.0:1787378187.290019:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378187.290032:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378187.290072:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787378187.290074:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626603392:0@lo:400:kworker.0 00000100:00100000:1.0:1787378187.290083:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626603136:0@lo:400:kworker.0 00000100:00100000:3.0:1787378187.290104:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378187.290124:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626602880 00000100:00100000:1.0:1787378187.290132:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626602880 00000100:00100000:2.0:1787378187.290150:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626603008:0@lo:400:kworker.0 00000100:00100000:0.0:1787378187.290249:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626603264 00000100:00100000:0.0:1787378187.290254:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626603264 00000100:00100000:0.0:1787378187.290296:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787378187.290305:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626603264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378187.290366:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787378187.290373:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626602880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378187.292504:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378187.292543:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626603520:0@lo:400:kworker.0 00000100:00100000:2.0:1787378187.292573:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378187.292621:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626603520 00000100:00100000:2.0:1787378187.292628:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626603520 00000100:00100000:2.0:1787378187.292671:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787378187.292679:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626603520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378187.292742:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626603520:12345-0@lo:400:kworker.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378187.292750:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787378187.292772:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626603392 00000100:00100000:2.0:1787378187.292789:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626603392 00000100:00100000:2.0:1787378187.292816:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626603008 00000100:00100000:2.0:1787378187.292819:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626603008 00000100:00100000:2.0:1787378187.292836:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787378187.292842:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626603392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378187.292874:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626603392:12345-0@lo:400:kworker.0 Request processed in 33us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378187.292880:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787378187.292890:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787378187.292896:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626603008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378187.292921:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626603008:12345-0@lo:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378187.292926:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787378187.292946:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378187.292950:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378187.292952:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378187.292977:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626603008:0@lo:400:kworker.0 00000100:00100000:2.0:1787378187.292986:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626603520:0@lo:400:kworker.0 00000100:00100000:0.0:1787378187.296401:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626603264:12345-0@lo:400:kworker.0 Request processed in 6089us (6361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378187.296415:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787378187.296481:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787378187.296547:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbb1e3800 x1874201626603264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378187.296560:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626603264:0@lo:400:kworker.0 00000100:00100000:2.0:1787378187.296797:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626603136 00000100:00100000:2.0:1787378187.296804:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626603136 00000100:00100000:1.0:1787378187.296934:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626602880:12345-0@lo:400:kworker.0 Request processed in 6560us (6913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378187.296955:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787378187.297015:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626603392:0@lo:400:kworker.0 00000100:00100000:3.0:1787378187.297031:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626602880:0@lo:400:kworker.0 00000100:00100000:2.0:1787378187.297050:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787378187.297060:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626603136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378187.297231:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626603136:0@lo:400:kworker.0 00000100:00080000:0.0:1787378187.297244:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378187.297309:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626603136:12345-0@lo:400:kworker.0 Request processed in 250us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378187.297315:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787378187.802022:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626603776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378187.802094:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378187.802167:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787378187.802175:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626603648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378187.802179:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626603776 00000100:00100000:0.0:1787378187.802188:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626603776 00000100:00100000:1.0:1787378187.802201:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378187.802231:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626603648 00000100:00100000:0.0:1787378187.802235:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626603648 00000100:00100000:0.0:1787378187.802254:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787378187.802260:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626603776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378187.802304:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378187.802404:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626603776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378187.802414:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787378187.802439:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787378187.802481:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626603776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378187.802549:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626603648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787378187.802576:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378187.802632:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626603648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (431us total) trans 0 rc 0/0 00010000:00080000:1.0:1787378187.802676:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50dc380 x1874201626603648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378187.802691:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626603648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378187.802999:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:2.0:1787378188.249961:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378189.274414:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378189.947775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378189.947823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378189.947950:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604547328 00000100:00100000:2.0:1787378189.947960:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604547328 00000100:00100000:2.0:1787378189.948019:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 283 00000100:00100000:2.0:1787378189.948029:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604547328:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378189.948100:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604547328:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 71us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378189.948108:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 283 00000100:00100000:0.0:1787378189.948299:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604547456 00000100:00100000:0.0:1787378189.948305:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604547456 00000100:00100000:0.0:1787378189.948363:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:0.0:1787378189.948371:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604547456:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378189.948413:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604547456:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 43us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378189.948421:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00080000:2.0:1787378189.952799:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378189.966093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378189.966207:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604547584 00000100:00100000:2.0:1787378189.966217:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604547584 00000100:00100000:2.0:1787378189.966300:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787378189.966320:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2352:x1874201604547584:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:2.0:1787378189.966350:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852ded 00000100:00080000:2.0:1787378189.966361:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eeb84426000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787378189.966415:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787378189.966692:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+2:2352:x1874201604547584:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 382us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378189.966701:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00010000:00010000:3.0:1787378189.967282:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787378189.967351:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378189.981803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378189.981888:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604547712 00000100:00100000:3.0:1787378189.981899:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604547712 00000100:00100000:3.0:1787378189.981977:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:3.0:1787378189.981987:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604547712:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378189.982070:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604547712:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378189.982078:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00080000:0.0:1787378189.982199:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787378190.297964:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378191.322651:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787378191.491138:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:1.0:1787378191.491148:0:7491:0:(genops.c:906:class_export_put()) final put ffff9eeb84423800/3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:2.0:1787378191.491351:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb84423800/3ca7eed4-13a1-4f52-9d12-97b20fe7905e for lustre-OST0001 00000020:00000080:2.0:1787378191.491408:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb84426000 for lustre-OST0001 00010000:00010000:1.0:1787378192.348643:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378192.415408:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787378192.415485:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787378192.415507:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626604032:0@lo:400:kworker.0 00000100:00100000:3.0:1787378192.415587:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378192.418326:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626604032 00000100:00100000:0.0:1787378192.418340:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626604032 00000100:00100000:0.0:1787378192.418456:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787378192.418467:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626604032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378192.418574:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626604032:12345-0@lo:400:kworker.0 Request processed in 109us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378192.418581:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787378192.418647:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626604032:0@lo:400:kworker.0 00000100:00100000:2.0:1787378192.418734:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626603904:0@lo:400:kworker.0 00000100:00100000:2.0:1787378192.418776:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378192.420325:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626604160:0@lo:400:kworker.0 00000100:00100000:1.0:1787378192.420381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378192.420418:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378192.420425:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626604288:0@lo:400:kworker.0 00000100:00100000:1.0:1787378192.420470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378192.420508:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626604160 00000100:00100000:1.0:1787378192.420514:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626604160 00000100:00100000:1.0:1787378192.420569:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787378192.420579:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626604160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378192.420623:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626604160:12345-0@lo:400:kworker.0 Request processed in 46us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378192.420629:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787378192.420648:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626604288 00000100:00100000:1.0:1787378192.420651:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626604288 00000100:00100000:1.0:1787378192.420675:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787378192.420680:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626604288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378192.420705:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626604288:12345-0@lo:400:kworker.0 Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378192.420710:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1787378192.420744:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787378192.420749:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787378192.420775:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebbb1e0700 x1874201626604288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378192.420788:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626604288:0@lo:400:kworker.0 00000100:00100000:1.0:1787378192.420797:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626604160:0@lo:400:kworker.0 00000100:00100000:3.0:1787378192.421055:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626604416:0@lo:400:kworker.0 00000100:00100000:3.0:1787378192.421087:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378192.421129:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787378192.421146:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626604544:0@lo:400:kworker.0 00000100:00100000:3.0:1787378192.421172:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378192.421204:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626604544 00000100:00100000:3.0:1787378192.421208:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626604544 00000100:00100000:3.0:1787378192.421236:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787378192.421243:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626604544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378192.421284:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626604544:12345-0@lo:400:kworker.0 Request processed in 40us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378192.421301:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787378192.421307:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626604544:0@lo:400:kworker.0 00000100:00080000:1.0:1787378192.421444:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378192.421455:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626604416 00000100:00100000:1.0:1787378192.421459:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626604416 00000100:00100000:1.0:1787378192.421504:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787378192.421519:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626604416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378192.421558:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626604416:12345-0@lo:400:kworker.0 Request processed in 40us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378192.421564:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787378192.421600:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626604416:0@lo:400:kworker.0 00000100:00080000:2.0:1787378192.421979:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378192.423233:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626603904 00000100:00100000:0.0:1787378192.423244:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626603904 00000100:00100000:0.0:1787378192.423358:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787378192.423368:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626603904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378192.423441:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626603904:12345-0@lo:400:kworker.0 Request processed in 75us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378192.423457:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787378192.423545:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626603904:0@lo:400:kworker.0 00000100:00100000:3.0:1787378192.922188:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787378192.922210:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626604672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378192.922273:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378192.922343:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626604672 00000100:00100000:3.0:1787378192.922351:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626604672 00000100:00100000:3.0:1787378192.922398:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787378192.922407:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626604672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787378192.922442:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378192.922485:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626604672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378192.922492:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787378192.922537:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626604672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378192.922982:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378192.922993:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626604800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378192.923025:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378192.923061:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626604800 00000100:00100000:1.0:1787378192.923065:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626604800 00000100:00100000:1.0:1787378192.923093:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787378192.923100:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626604800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787378192.923120:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378192.923335:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626604800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 234us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378192.923342:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787378192.923373:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebb50dea00 x1874201626604800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378192.923387:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626604800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787378193.373526:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787378194.010969:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787378194.394253:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378195.073599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378195.073685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378195.073714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378195.073897:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604547840 00000100:00100000:3.0:1787378195.073907:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604547840 00000100:00100000:3.0:1787378195.073958:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 285 00000100:00100000:3.0:1787378195.073968:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604547840:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378195.074035:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604547840:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 68us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378195.074054:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 285 00000100:00100000:1.0:1787378195.074638:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604547968 00000100:00100000:1.0:1787378195.074645:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604547968 00000100:00100000:1.0:1787378195.074691:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604548096 00000100:00100000:1.0:1787378195.074695:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604548096 00000100:00100000:1.0:1787378195.074738:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:1.0:1787378195.074746:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604547968:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378195.074789:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604547968:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 44us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378195.074795:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:1.0:1787378195.074817:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:1.0:1787378195.074838:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604548096:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378195.076005:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604548096:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1161us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378195.076015:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00080000:2.0:1787378195.078122:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787378195.418123:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787378195.655224:0:11697:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:56:34 (1787378194) 00010000:00010000:0.0:1787378196.442247:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378197.232828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378197.234538:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604548224 00000100:00100000:1.0:1787378197.234552:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604548224 00000100:00100000:1.0:1787378197.234651:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1787378197.234662:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:10219:x1874201604548224:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378197.234682:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378197.234791:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7852eb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e20 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378197.234859:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7852ebf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378197.234871:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7852ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378197.234883:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7852ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787378197.234968:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787378197.235088:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787378197.235093:0:9982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378197.235186:0:9982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7852ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378197.235211:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7852eb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e20 expref: 7 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378197.235715:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7852ebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e20 expref: 6 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378197.235803:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524c00) 00010000:00010000:1.0:1787378197.235805:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787378197.235808:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546e00, rc 0) 00000100:00100000:1.0:1787378197.235883:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:10219:x1874201604548224:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1223us (3063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378197.235891:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1787378197.243392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378197.245488:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604548352 00000100:00100000:3.0:1787378197.245504:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604548352 00000100:00100000:3.0:1787378197.245814:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:3.0:1787378197.245826:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:10220:x1874201604548352:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787378197.245847:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378197.245868:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7852ec6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e27 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.245942:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.245955:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.245966:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.245979:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.245985:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.245991:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248105:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04800/0xdd3c5462d7852edb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248134:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04800/0xdd3c5462d7852edb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248146:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04800/0xdd3c5462d7852edb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378197.248237:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787378197.248241:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378197.248331:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04800/0xdd3c5462d7852edb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248343:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248350:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248357:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248363:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378197.248367:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248374:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248386:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524c00) 00010000:00010000:3.0:1787378197.248389:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378197.248394:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248410:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248424:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248430:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248436:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248441:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378197.248444:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248449:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248457:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9eeb97cb4600) 00010000:00010000:3.0:1787378197.248460:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378197.248462:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248468:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ed4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248505:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7852ec6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e27 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248517:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04800/0xdd3c5462d7852edb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e27 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.248530:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:3.0:1787378197.248532:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378197.248535:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04800, rc 0) 00000100:00100000:3.0:1787378197.248985:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:10220:x1874201604548352:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 3159us (5600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378197.248995:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1787378197.258716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378197.260709:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604548608 00000100:00100000:3.0:1787378197.260734:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604548608 00000100:00100000:3.0:1787378197.260804:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1787378197.260814:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:10220:x1874201604548608:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787378197.260833:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378197.260852:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7852ee2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e2e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.260930:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.260944:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.260955:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.260970:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.260977:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.260998:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.261790:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05600/0xdd3c5462d7852ef7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.261803:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05600/0xdd3c5462d7852ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378197.261810:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05600/0xdd3c5462d7852ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378197.261820:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787378197.269928:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.269946:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.269954:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.269959:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378197.269964:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.269971:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270004:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:2.0:1787378197.270007:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378197.270012:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270018:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7852ee9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270034:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270040:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270046:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270051:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378197.270054:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270060:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270068:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eeb97cb4600) 00010000:00010000:2.0:1787378197.270070:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378197.270073:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270079:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7852ef0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270531:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7852ee2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e2e expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270548:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05600/0xdd3c5462d7852ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e2e expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378197.270556:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:2.0:1787378197.270558:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378197.271272:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05600, rc 0) 00000100:00100000:2.0:1787378197.271351:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:10220:x1874201604548608:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 10535us (12641us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787378197.271361:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1787378197.278702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378197.278822:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604548736 00000100:00100000:1.0:1787378197.278831:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604548736 00000100:00100000:1.0:1787378197.278889:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1787378197.278899:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:10220:x1874201604548736:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787378197.279016:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:10220:x1874201604548736:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 118us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378197.279023:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00010000:00010000:1.0:1787378197.467308:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378197.530343:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626605184:0@lo:400:kworker.0 00000100:00100000:0.0:1787378197.530409:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378197.530477:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787378197.530483:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626605312:0@lo:400:kworker.0 00000100:00100000:0.0:1787378197.530507:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378197.530548:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626605312 00000100:00100000:0.0:1787378197.530557:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626605312 00000100:00100000:0.0:1787378197.530608:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787378197.530617:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626605312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378197.530663:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626605312:12345-0@lo:400:kworker.0 Request processed in 47us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378197.530671:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787378197.530690:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787378197.530745:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eeb881f0e00 x1874201626605312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787378213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378197.530760:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626605312:0@lo:400:kworker.0 00000100:00100000:2.0:1787378197.530825:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626605184 00000100:00100000:2.0:1787378197.530830:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626605184 00000100:00100000:2.0:1787378197.530872:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787378197.530879:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626605184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378197.530920:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626605184:12345-0@lo:400:kworker.0 Request processed in 40us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378197.530926:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787378197.531053:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626605056:0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531083:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378197.531111:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626605568:0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531131:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378197.531149:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787378197.531155:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626604928:0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531179:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378197.531199:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626605440:0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531219:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378197.531246:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626605568 00000100:00100000:3.0:1787378197.531250:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626605568 00000100:00100000:3.0:1787378197.531288:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787378197.531295:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626605568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531331:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626605568:12345-0@lo:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378197.531348:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787378197.531366:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626605056 00000100:00100000:3.0:1787378197.531369:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626605056 00000100:00100000:3.0:1787378197.531386:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626605440 00000100:00100000:3.0:1787378197.531388:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626605440 00000100:00100000:3.0:1787378197.531404:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787378197.531410:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626605056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531440:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626605056:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378197.531445:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787378197.531458:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787378197.531463:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626605440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531487:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626605440:12345-0@lo:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378197.531493:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787378197.531536:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626605440:0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531545:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626605056:0@lo:400:kworker.0 00000100:00100000:3.0:1787378197.531553:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626605568:0@lo:400:kworker.0 00000100:00100000:0.0:1787378197.531715:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626604928 00000100:00100000:0.0:1787378197.531749:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626604928 00000100:00100000:0.0:1787378197.531782:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787378197.531789:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626604928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378197.531823:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626604928:12345-0@lo:400:kworker.0 Request processed in 35us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378197.531839:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1787378197.531864:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787378197.531868:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378197.531886:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626605184:0@lo:400:kworker.0 00000100:00100000:2.0:1787378197.531956:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626604928:0@lo:400:kworker.0 00000100:00100000:3.0:1787378198.042276:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626605696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378198.042358:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378198.042530:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626605696 00000100:00100000:1.0:1787378198.042538:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626605696 00000100:00100000:1.0:1787378198.042586:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787378198.042595:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626605696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378198.042630:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378198.042677:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626605696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378198.042694:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787378198.042761:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626605696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378198.043346:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626605824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378198.043382:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378198.043470:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626605824 00000100:00100000:3.0:1787378198.043475:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626605824 00000100:00100000:3.0:1787378198.043508:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787378198.043515:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626605824:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378198.043516:0:6591:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787378198.043528:0:6591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787378198.043556:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378198.043593:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626605824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378198.043599:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787378198.044597:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebae216300 x1874201626605824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378198.044618:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626605824:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787378198.106281:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787378198.490139:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378199.518877:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378199.626328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378199.626412:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604548864 00000100:00100000:3.0:1787378199.626421:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604548864 00000100:00100000:3.0:1787378199.626495:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1787378199.626516:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:10262:x1874201604548864:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378199.626538:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378199.626558:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.626635:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.626648:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.626660:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.626674:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.626681:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.626688:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.626984:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.626993:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.627000:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.627006:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378199.627011:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.627020:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628820:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524c00) 00010000:00010000:3.0:1787378199.628829:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378199.628836:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628845:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628863:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628870:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628876:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628888:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378199.628891:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628898:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628908:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eeb97cb4c00) 00010000:00010000:3.0:1787378199.628910:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378199.628912:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628918:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628968:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852f05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e35 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628979:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524c00) 00010000:00010000:3.0:1787378199.628981:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378199.628985:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e35 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.628995:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05c00, rc 0) 00000100:00100000:3.0:1787378199.630181:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:10262:x1874201604548864:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 3669us (3855us total) trans 0 rc 301/301 00000100:00100000:3.0:1787378199.630194:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00080000:0.0:1787378199.630604:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378199.643478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378199.643634:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604549120 00000100:00100000:0.0:1787378199.643644:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604549120 00000100:00100000:0.0:1787378199.643701:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1787378199.643711:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:10262:x1874201604549120:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:0.0:1787378199.643790:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378199.643817:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7852ebf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e20 expref: 9 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.643837:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524c00) 00010000:00010000:0.0:1787378199.643848:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378199.644122:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.644135:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.644155:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.644169:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.644176:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.644182:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378199.645212:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787378199.645226:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.645233:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.645239:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.645257:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378199.645261:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.645268:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.645279:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378199.645281:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378199.645292:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.645298:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378199.645316:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004af8d961 reply state 00000000080661de transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378199.645326:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787378199.645446:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:10262:x1874201604549120:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 1733us (1975us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787378199.645455:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00010000:00010000:3.0:1787378199.648949:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.648967:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.648975:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.648981:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128bc00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378199.648985:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.648993:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.649009:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eeb829cdb00) 00010000:00010000:3.0:1787378199.649012:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378199.649017:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.649023:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f21 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378199.781299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378199.782144:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604549248 00000100:00100000:2.0:1787378199.782158:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604549248 00000100:00100000:2.0:1787378199.782254:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:2.0:1787378199.782265:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:10271:x1874201604549248:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:2.0:1787378199.782288:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378199.782313:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e3c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.782377:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852f2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.782390:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.782402:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378199.782456:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787378199.782459:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378199.782492:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.782513:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e3c expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.782533:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852f2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e3c expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.782542:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378199.782545:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378199.782547:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7c00, rc 0) 00000100:00100000:2.0:1787378199.786189:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:10271:x1874201604549248:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 348us (2794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378199.786231:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1787378199.892715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378199.895304:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604549376 00000100:00100000:0.0:1787378199.895319:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604549376 00000100:00100000:0.0:1787378199.895455:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1787378199.895466:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:10277:x1874201604549376:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378199.895486:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378199.895506:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e43 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.895567:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.895597:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.895610:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.895624:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.895657:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.895664:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898412:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898431:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898443:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378199.898485:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787378199.898490:0:9982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787378199.898532:0:9982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898545:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898551:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898557:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898562:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378199.898566:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898604:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898617:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:0.0:1787378199.898620:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378199.898625:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898632:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852f3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898898:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898905:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898911:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898916:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378199.898920:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898938:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898947:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378199.898950:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378199.898953:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.898969:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852f44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.899012:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7852f36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e43 expref: 12 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.899026:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e43 expref: 11 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.899034:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:0.0:1787378199.899036:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787378199.899039:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128bc00, rc 0) 00000100:00100000:0.0:1787378199.899233:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:10277:x1874201604549376:12345-192.168.203.22@tcp:101:bash.0 Request processed in 3767us (6528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378199.899252:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1787378199.908067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378199.908204:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604549632 00000100:00100000:3.0:1787378199.908214:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604549632 00000100:00100000:3.0:1787378199.908292:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1787378199.908301:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:10277:x1874201604549632:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787378199.908322:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378199.908341:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852f52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e4a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.908489:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.908502:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.908513:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.908570:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.908578:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.908585:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787378199.910923:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787378199.911146:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911163:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911175:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911218:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911226:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911301:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911308:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378199.911313:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911320:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911332:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378199.911334:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378199.911339:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911361:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7852f59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378199.911374:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b36963c8 reply state 000000002957c7e5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378199.911382:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787378199.911424:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d7852f52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911440:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378199.911447:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e600) 00010000:00010000:2.0:1787378199.911449:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378199.911452:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6600, rc 0) 00000100:00100000:2.0:1787378199.911545:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10277:x1874201604549632:12345-192.168.203.22@tcp:101:bash.0 Request processed in 3244us (3752us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787378199.911555:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00010000:00010000:3.0:1787378199.917182:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.917198:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.917206:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.917212:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378199.917217:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.917262:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.917278:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb97cb4c00) 00010000:00010000:3.0:1787378199.917280:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378199.917285:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.917291:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7852f60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378199.922926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378199.923027:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604549760 00000100:00100000:0.0:1787378199.923037:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604549760 00000100:00100000:0.0:1787378199.923087:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1787378199.923095:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874201604549760:12345-192.168.203.22@tcp:8:bash.0 00010000:00080000:0.0:1787378199.923126:0:6589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:0.0:1787378199.923161:0:6589:0:(genops.c:1406:class_connect()) connect: client 3ca7eed4-13a1-4f52-9d12-97b20fe7905e, cookie 0xdd3c5462d7852f75 00002000:00100000:0.0:1787378199.923174:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ca7eed4-13a1-4f52-9d12-97b20fe7905e/ffff9eeb8761b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787378199.923196:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787378199.923453:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787378199.923484:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9eeb8761c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378199.923586:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2352:x1874201604549760:12345-192.168.203.22@tcp:8:bash.0 Request processed in 489us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378199.923594:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:1.0:1787378199.926594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378199.926690:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604549888 00000100:00100000:3.0:1787378199.926699:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604549888 00000100:00100000:3.0:1787378199.926801:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1787378199.926811:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:0:x1874201604549888:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787378199.926827:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378199.926851:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e51 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787378199.926887:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378199.926905:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1787378199.926909:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378199.926917:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 7 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.926936:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 7 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.926972:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05400, rc 0) 00000100:00100000:3.0:1787378199.927044:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:0:x1874201604549888:12345-192.168.203.22@tcp:101:bash.0 Request processed in 234us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378199.927051:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00080000:0.0:1787378199.930104:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378199.939174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378199.939373:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604550016 00000100:00100000:0.0:1787378199.939383:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604550016 00000100:00100000:0.0:1787378199.939439:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:0.0:1787378199.939448:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:10277:x1874201604550016:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378199.939465:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378199.939488:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e58 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.939518:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.939527:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378199.939531:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378199.939536:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.939568:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.939580:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 8 pid: 6586 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378199.939593:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6589:1874201626605952:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378199.939692:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb88073780 going to sleep for 11 seconds 00000100:00100000:2.0:1787378199.950330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378199.950412:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604550144 00000100:00100000:3.0:1787378199.950421:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604550144 00010000:00010000:3.0:1787378199.950461:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 9 pid: 6586 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378199.950518:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1787378199.950529:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2354:x1874201604550144:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378199.950544:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378199.950567:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 9 pid: 6586 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.950582:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 9 pid: 6586 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.950607:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378199.950611:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378199.950619:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.950629:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378199.950688:0:5776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378199.950702:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5776:1874201626606080:192.168.203.22@tcp:105: 00000100:00100000:3.0:1787378199.950829:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb85693f00 going to sleep for 11 seconds 00010000:00010000:0.0:1787378199.951284:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7852f7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e51 expref: 9 pid: 6586 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378199.951301:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6589:1874201626605952:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378199.951324:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378199.951335:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:0.0:1787378199.951417:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:10277:x1874201604550016:12345-192.168.203.22@tcp:101:bash.0 Request processed in 11969us (12264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378199.951425:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:0.0:1787378199.956068:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5776:1874201626606080:192.168.203.22@tcp:105: 00010000:00010000:0.0:1787378199.956097:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378199.959950:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604550144:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 9411us (9618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378199.959965:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:2.0:1787378199.967095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378199.968383:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604550400 00000100:00100000:3.0:1787378199.968397:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604550400 00000100:00100000:3.0:1787378199.968468:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1787378199.968479:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10277:x1874201604550400:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1787378199.968987:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10277:x1874201604550400:12345-192.168.203.22@tcp:35:bash.0 Request processed in 507us (1899us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787378199.968995:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1787378200.117832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378200.117991:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604550656 00000100:00100000:2.0:1787378200.118001:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604550656 00000100:00100000:2.0:1787378200.118065:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1787378200.118075:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10287:x1874201604550656:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378200.118099:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378200.118136:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852f8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e5f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378200.118267:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787378200.118394:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852f8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e5f expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.118409:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378200.118412:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378200.118417:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852f8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e5f expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.118433:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6400, rc 0) 00000100:00100000:2.0:1787378200.118506:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10287:x1874201604550656:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 432us (694us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787378200.118514:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1787378200.126882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378200.127036:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604550912 00000100:00100000:3.0:1787378200.127046:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604550912 00000100:00100000:3.0:1787378200.127105:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1787378200.127115:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10287:x1874201604550912:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787378200.127383:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:10287:x1874201604550912:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 268us (509us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787378200.127391:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787378200.188551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378200.188599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378200.188684:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604551168 00000100:00100000:3.0:1787378200.188694:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604551168 00000100:00100000:3.0:1787378200.188809:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:3.0:1787378200.188820:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604551168:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378200.188913:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604551168:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378200.188921:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00080000:0.0:1787378200.189142:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378200.189364:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604551040 00000100:00100000:2.0:1787378200.189369:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604551040 00000100:00100000:2.0:1787378200.189407:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 287 00000100:00100000:2.0:1787378200.189415:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604551040:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378200.189453:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604551040:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378200.189459:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 287 00000100:00100000:1.0:1787378200.254480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378200.254603:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604551296 00000100:00100000:2.0:1787378200.254614:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604551296 00000100:00100000:2.0:1787378200.254682:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:2.0:1787378200.254693:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:10293:x1874201604551296:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378200.254772:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378200.254803:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852f98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e66 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.254994:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852f9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.255008:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.255020:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378200.255080:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787378200.255084:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378200.255108:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.255134:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7852f98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e66 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.255154:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e66 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.255163:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378200.255166:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378200.255170:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7200, rc 0) 00000100:00100000:2.0:1787378200.255244:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:10293:x1874201604551296:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 544us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378200.255252:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1787378200.277179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378200.279980:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604551552 00000100:00100000:3.0:1787378200.279997:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604551552 00000100:00100000:3.0:1787378200.280079:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1787378200.280089:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:10293:x1874201604551552:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378200.280110:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378200.280132:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852fa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e6d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.280246:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.280261:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.280273:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378200.280284:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787378200.280407:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852fa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e6d expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.280427:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e6d expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.280436:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e600) 00010000:00010000:3.0:1787378200.280451:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378200.280456:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04000, rc 0) 00000100:00100000:3.0:1787378200.280680:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10293:x1874201604551552:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 591us (3509us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787378200.280688:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1787378200.294981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378200.295040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378200.295078:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604551808 00000100:00100000:0.0:1787378200.295089:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604551808 00000100:00100000:2.0:1787378200.295144:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604551936 00000100:00100000:2.0:1787378200.295149:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604551936 00000100:00100000:0.0:1787378200.295159:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1787378200.295172:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10293:x1874201604551808:12345-192.168.203.22@tcp:101:lfs.0 00000100:00100000:2.0:1787378200.295196:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00010000:00010000:0.0:1787378200.295197:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787378200.295207:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:2355:x1874201604551936:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378200.295221:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852fbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e74 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.295222:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378200.295261:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e6d expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.295280:0:8358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e600) 00010000:00010000:2.0:1787378200.295286:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378200.295343:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:2355:x1874201604551936:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 138us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378200.295352:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00010000:00010000:0.0:1787378200.295358:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852fc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.295374:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.295386:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378200.295399:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787378200.295523:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7852fbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e74 expref: 21 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.295537:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e74 expref: 20 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.295544:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e600) 00010000:00010000:0.0:1787378200.295547:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787378200.295550:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128be00, rc 0) 00000100:00100000:0.0:1787378200.295591:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10293:x1874201604551808:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 421us (619us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787378200.295598:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1787378200.313279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378200.313933:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604552064 00000100:00100000:0.0:1787378200.313944:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604552064 00000100:00100000:0.0:1787378200.314011:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1787378200.314022:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604552064:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:0.0:1787378200.314253:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.314284:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.314293:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378200.314298:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787378200.314302:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.314338:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.314352:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378200.314368:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1874201626606208:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378200.314509:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb88073780 going to sleep for 11 seconds 00000100:00100000:2.0:1787378200.320435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378200.320958:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1874201626606208:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378200.320984:0:6586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378200.321803:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604552192 00000100:00100000:1.0:1787378200.321813:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604552192 00002000:00100000:1.0:1787378200.321874:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9eeb881f0a80 x1874201604552192/t0(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:271/0 lens 504/0 e 0 to 0 dl 1787378211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787378200.321886:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb881f0a80 with x1874201604552192 ext(0->12) 00010000:00010000:1.0:1787378200.321895:0:6592:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 8 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.321911:0:6592:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 8 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787378200.321920:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9eeb881f0a80 00000100:00100000:1.0:1787378200.321954:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787378200.321980:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604552192:12345-192.168.203.22@tcp:4:lfs.0 00000001:00100000:1.0:1787378200.403298:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000001:00080000:3.0:1787378200.484072:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1787378200.484331:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604552192:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 162347us (163900us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787378200.484344:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00002000:00100000:1.0:1787378200.484356:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9eeb881f0a80 x1874201604552192/t4294967299(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:271/0 lens 504/448 e 0 to 0 dl 1787378211 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787378200.484366:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb881f0a80 with x1874201604552192 ext(0->12) 00010000:00010000:1.0:1787378200.484376:0:6592:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.484394:0:6592:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787378200.484401:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9eeb881f0a80 00000100:00100000:2.0:1787378200.489807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378200.490013:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604552320 00000100:00100000:3.0:1787378200.490022:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604552320 00010000:00010000:3.0:1787378200.490552:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378200.490597:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1787378200.490608:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604552320:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378200.490622:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787378200.490640:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787378200.490643:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787378199 00002000:00010000:3.0:1787378200.490646:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787378200 00002000:00010000:3.0:1787378200.490648:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787378199 00002000:00010000:3.0:1787378200.490650:0:5778:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787378200.490656:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.490670:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.490748:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000109602d8/0xdd3c5462d7852f83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e58 expref: 7 pid: 6589 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.490765:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378200.490769:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378200.490775:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.490792:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.490822:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378200.490873:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604552320:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 267us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378200.490884:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00010000:00010000:0.0:1787378200.491024:0:6586:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.491034:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.491070:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.491079:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.491087:0:6586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.491093:0:6586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378200.491098:0:6586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.491106:0:6586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.491119:0:6586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.491126:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a619163d/0xdd3c5462d7852fd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378200.491168:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604552064:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 177149us (177899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378200.491176:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1787378200.496508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378200.496601:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604552576 00000100:00100000:1.0:1787378200.496615:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604552576 00000100:00100000:1.0:1787378200.496673:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1787378200.496684:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10293:x1874201604552576:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:1.0:1787378200.496795:0:5793:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e74 expref: 20 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787378200.497092:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787378200.497153:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787378200.498073:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787378200.498144:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.498165:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.498173:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.498280:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.498295:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 24 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378200.498309:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3db100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5793:1874201626606336:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378200.498446:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8666b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378200.503553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378200.503643:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604552704 00000100:00100000:0.0:1787378200.503652:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604552704 00010000:00010000:0.0:1787378200.503691:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 25 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378200.503764:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1787378200.503774:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:2353:x1874201604552704:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378200.503797:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378200.503805:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 25 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.504035:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 25 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.504070:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e600) 00010000:00010000:0.0:1787378200.504076:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.504085:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.504092:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.504111:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378200.504213:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:2353:x1874201604552704:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 440us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378200.504221:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00010000:00010000:1.0:1787378200.505482:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852f67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e4a expref: 24 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378200.505976:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3db100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5793:1874201626606336:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378200.506005:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.506015:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.506020:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787378200.506156:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787378200.506383:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787378200.506966:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3db100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626606464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787378200.507031:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378200.507076:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb905ffc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787378200.508221:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626606464 00000100:00100000:2.0:1787378200.508233:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626606464 00000100:00100000:2.0:1787378200.508312:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378200.508323:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1874201626606464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787378200.508435:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1874201626606464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378200.508443:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787378200.508564:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378200.508651:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3db100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626606464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787378200.509576:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787378200.509660:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3db100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626606592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787378200.509750:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378200.510195:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626606592 00000100:00100000:2.0:1787378200.510202:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626606592 00000100:00100000:2.0:1787378200.510256:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378200.510265:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1874201626606592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787378200.510501:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5793:x1874201626606592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 237us (750us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787378200.510508:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787378200.511278:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb905ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378200.511312:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3db100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626606592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787378200.511381:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787378200.511432:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.511444:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.511451:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.511456:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378200.511461:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.511470:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.511486:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e600) 00010000:00010000:1.0:1787378200.511489:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787378200.511513:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.511520:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7852fd7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787378200.512990:0:5793:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787378200.513543:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787378200.513557:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336775836451ns, next at 337775833577ns, rc = 0 00000001:00080000:1.0:1787378200.513567:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787378200.513621:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e600) 00010000:00010000:1.0:1787378200.513625:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787378200.513634:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7852fc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e74 expref: 28 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378200.513787:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10293:x1874201604552576:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 17104us (17288us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787378200.513799:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000020:00080000:1.0:1787378200.513804:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787378200.518596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378200.518830:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604552832 00000100:00100000:1.0:1787378200.518846:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604552832 00000100:00100000:1.0:1787378200.518919:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:1.0:1787378200.518931:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10293:x1874201604552832:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378200.518957:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378200.518979:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852fde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e7b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.519037:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e7b expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.519083:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e7b expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.519101:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:1.0:1787378200.519105:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378200.519108:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547e00, rc 0) 00000100:00100000:1.0:1787378200.519171:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:10293:x1874201604552832:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 242us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378200.519178:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1787378200.526975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378200.527087:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604553088 00000100:00100000:0.0:1787378200.527101:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604553088 00000100:00100000:0.0:1787378200.527174:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:0.0:1787378200.527185:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:10293:x1874201604553088:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787378200.527521:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10293:x1874201604553088:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 337us (740us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787378200.527530:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00010000:00010000:1.0:1787378200.537846:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378200.633289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378200.633595:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604553344 00000100:00100000:2.0:1787378200.633613:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604553344 00000100:00100000:2.0:1787378200.634027:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1787378200.634044:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10303:x1874201604553344:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378200.634081:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378200.634108:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852fe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e82 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378200.634295:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787378200.634463:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852fe5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e82 expref: 31 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.634481:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378200.634484:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378200.634491:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7852fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e82 expref: 31 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378200.634512:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6600, rc 0) 00000100:00100000:2.0:1787378200.634607:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:10303:x1874201604553344:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 567us (1335us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787378200.634615:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1787378200.639581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378200.639805:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604553472 00000100:00100000:3.0:1787378200.639820:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604553472 00000100:00100000:3.0:1787378200.639896:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1787378200.639909:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:10303:x1874201604553472:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1787378200.640015:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.640036:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.640062:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.640092:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.640099:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.640106:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641543:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641560:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641571:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787378200.641636:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641653:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641660:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641668:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641693:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378200.641699:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641708:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641846:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378200.641850:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378200.641857:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641864:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7852ff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641883:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641889:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641895:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641900:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378200.641903:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641908:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641928:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb97cb4600) 00010000:00010000:3.0:1787378200.641931:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378200.641934:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641940:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7852ffa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641959:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641965:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641971:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641977:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378200.641980:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641986:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.641993:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:3.0:1787378200.641996:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378200.641999:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378200.642004:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853001 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378200.642440:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:10303:x1874201604553472:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 2527us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378200.642463:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1787378200.647595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378200.647740:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604553728 00000100:00100000:0.0:1787378200.647753:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604553728 00000100:00100000:0.0:1787378200.647865:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1787378200.647878:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:10303:x1874201604553728:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787378200.650095:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10303:x1874201604553728:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 2200us (2620us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787378200.650343:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787378200.722846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378200.722962:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604553984 00000100:00100000:0.0:1787378200.722975:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604553984 00000100:00100000:0.0:1787378200.723061:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1787378200.723074:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10306:x1874201604553984:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378200.723109:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378200.723416:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853008 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e89 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723525:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723542:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723575:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723591:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723598:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723604:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723806:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723814:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723821:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378200.723831:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787378200.723949:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723956:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723963:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723970:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378200.723981:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.723990:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724004:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:0.0:1787378200.724007:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378200.724011:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724029:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785300f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724046:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724053:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724058:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724064:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378200.724067:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724073:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724081:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378200.724084:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378200.724092:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.724099:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853016 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.725431:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853008 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 34 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.725457:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 33 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378200.725466:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378200.725469:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378200.725471:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a000, rc 0) 00000100:00100000:1.0:1787378200.726496:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:10306:x1874201604553984:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 3415us (3654us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787378200.726511:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1787378200.735520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378200.739016:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604554112 00000100:00100000:1.0:1787378200.739038:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604554112 00000100:00100000:1.0:1787378200.739184:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:1.0:1787378200.739198:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:10306:x1874201604554112:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:1.0:1787378200.739307:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739329:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739346:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739403:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739414:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739420:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739426:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378200.739431:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739439:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739453:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:1.0:1787378200.739457:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787378200.739461:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378200.739468:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785302b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378200.739586:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:10306:x1874201604554112:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 389us (4077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378200.739595:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:2.0:1787378200.743143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378200.744077:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604554368 00000100:00100000:1.0:1787378200.744093:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604554368 00000100:00100000:1.0:1787378200.744320:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:1.0:1787378200.744352:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:10306:x1874201604554368:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378200.744762:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:10306:x1874201604554368:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 370us (1602us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787378200.744771:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787378201.090223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378201.090438:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604554624 00000100:00100000:3.0:1787378201.090450:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604554624 00000100:00080000:0.0:1787378201.090534:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378201.090540:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:3.0:1787378201.090554:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:10337:x1874201604554624:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:3.0:1787378201.090586:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378201.090611:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853032 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e90 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.091057:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853039 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.091295:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.091308:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378201.091325:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787378201.091503:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853032 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e90 expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.091525:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e90 expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.091535:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:2.0:1787378201.091538:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378201.091542:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7600, rc 0) 00000100:00100000:2.0:1787378201.091666:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:10337:x1874201604554624:12345-192.168.203.22@tcp:101:cat.0 Request processed in 1116us (1465us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787378201.091675:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1787378201.116162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378201.116229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378201.116443:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604555008 00000100:00100000:1.0:1787378201.116455:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604555008 00000100:00100000:1.0:1787378201.116525:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:1.0:1787378201.116537:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:10337:x1874201604555008:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:1.0:1787378201.117037:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:10337:x1874201604555008:12345-192.168.203.22@tcp:35:cat.0 Request processed in 500us (805us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787378201.117047:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787378201.117587:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604554752 00000100:00100000:0.0:1787378201.117595:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604554752 00000100:00100000:0.0:1787378201.117657:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1787378201.117666:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:2354:x1874201604554752:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378201.117681:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378201.117761:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853039 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e90 expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.117786:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378201.117792:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378201.117826:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:2354:x1874201604554752:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 161us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378201.117833:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1787378201.255825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378201.256113:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604555264 00000100:00100000:3.0:1787378201.256128:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604555264 00000100:00100000:3.0:1787378201.256226:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787378201.256247:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:10343:x1874201604555264:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:3.0:1787378201.256285:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378201.256289:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787378201.256325:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7852f9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e66 expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.256351:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378201.256357:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378201.256376:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853047 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e97 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.256508:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.256532:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 36 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.256542:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.256584:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 36 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.256599:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 36 pid: 9982 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378201.256616:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad231880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626606720:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378201.256820:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb85693780 going to sleep for 11 seconds 00000100:00100000:1.0:1787378201.260266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378201.260450:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad231880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626606720:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378201.260485:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378201.260825:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604555392 00000100:00100000:2.0:1787378201.260836:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604555392 00010000:00010000:2.0:1787378201.260891:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 37 pid: 9982 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378201.260937:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:2.0:1787378201.260949:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:2353:x1874201604555392:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378201.260970:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378201.260977:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 37 pid: 9982 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.260991:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 37 pid: 9982 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.261080:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785301d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e89 expref: 37 pid: 9982 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.261100:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:2.0:1787378201.261106:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.261117:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.261126:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.261249:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378201.261319:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:2353:x1874201604555392:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 372us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378201.261342:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00010000:00010000:0.0:1787378201.268118:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.268140:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378201.268252:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787378201.268595:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853047 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 37 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.268621:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 36 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.268632:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378201.268636:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787378201.268640:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05800, rc 0) 00000100:00100000:0.0:1787378201.269025:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:10343:x1874201604555264:12345-192.168.203.22@tcp:101:dd.0 Request processed in 12778us (13213us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787378201.269037:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:1.0:1787378201.274419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378201.274786:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604555648 00000100:00100000:3.0:1787378201.274799:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604555648 00000100:00100000:3.0:1787378201.274880:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1787378201.274892:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:10343:x1874201604555648:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:3.0:1787378201.275296:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.275317:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.275343:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787378201.275636:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787378201.275668:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f88b41e reply state 00000000027ff68a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378201.275681:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787378201.276111:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+39:10343:x1874201604555648:12345-192.168.203.22@tcp:36:dd.0 Request processed in 1217us (1702us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787378201.276121:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000020:00080000:3.0:1787378201.276128:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787378201.278381:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.278402:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.278409:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.278415:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378201.278421:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.278428:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.278449:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:3.0:1787378201.278452:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378201.278477:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.278483:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785305c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378201.561917:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378201.617856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378201.618755:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604555776 00000100:00100000:2.0:1787378201.618772:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604555776 00000100:00100000:2.0:1787378201.618861:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:2.0:1787378201.618874:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+38:10357:x1874201604555776:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:2.0:1787378201.618911:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378201.618941:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6e9e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619067:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619084:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619098:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619115:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619122:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619129:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619283:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619308:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 39 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619317:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619364:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 39 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.619379:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 39 pid: 5792 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378201.619395:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626606848:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378201.619556:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787378201.627763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378201.627788:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626606848:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378201.627814:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604556032 00000100:00100000:1.0:1787378201.627825:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604556032 00010000:00010000:3.0:1787378201.627842:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378201.627897:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1787378201.627911:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:5567:x1874201604556032:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787378201.628689:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+41:5567:x1874201604556032:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 515us (715us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787378201.628702:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1787378201.633167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378201.633762:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604556160 00000100:00100000:0.0:1787378201.633775:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604556160 00010000:00010000:0.0:1787378201.633831:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 41 pid: 5792 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378201.633927:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1787378201.633939:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+41:2353:x1874201604556160:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378201.633961:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378201.633972:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 41 pid: 5792 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.634005:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 41 pid: 5792 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.634034:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785304e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e97 expref: 41 pid: 5792 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.634055:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378201.634060:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.634071:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.634079:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.634115:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378201.634367:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:2353:x1874201604556160:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 428us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378201.634375:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00010000:00010000:3.0:1787378201.634439:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634448:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378201.634521:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787378201.634527:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378201.634584:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634599:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634610:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634617:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634624:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634641:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378201.634646:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634654:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634665:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378201.634668:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378201.634672:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634678:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785306a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634692:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634698:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634706:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634712:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378201.634716:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634772:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634792:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeba261e100) 00010000:00010000:3.0:1787378201.634795:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378201.634798:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634805:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634871:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e9e expref: 40 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634887:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e9e expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378201.634895:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:3.0:1787378201.634898:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378201.634901:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7600, rc 0) 00000100:00100000:3.0:1787378201.634936:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+39:10357:x1874201604555776:12345-192.168.203.22@tcp:101:stat.0 Request processed in 16065us (17094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378201.634944:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000001:00080000:1.0:1787378201.726752:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000001:00080000:1.0:1787378201.727341:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:1.0:1787378201.727375:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787378201.727402:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eeb905ff600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787378201.727408:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eebad36be00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb905ffc00 00000020:00080000:1.0:1787378201.727412:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eebad36b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eebb53c7800 00000020:00080000:0.0:1787378201.727505:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787378201.727683:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787378201.727859:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626606976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787378201.728038:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378201.728277:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626606976 00000100:00100000:1.0:1787378201.728288:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626606976 00000100:00100000:1.0:1787378201.728364:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787378201.728375:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626606976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787378201.728415:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787378201.728475:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a893a17, atime: 0x6a893a18, ctime: 0x6a893a17, blocks: 0xb 00010000:00010000:1.0:1787378201.728619:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378201.728641:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1787378201.728646:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378201.728654:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378201.728674:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378201.728686:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378201.728695:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378201.728816:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378201.729148:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378201.729158:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.729168:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378201.729174:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.729191:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.729211:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.729219:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2362101/0xdd3c5462d785307f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.729256:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378201.729258:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378201.729261:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378201.729755:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626606976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1344us (1682us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787378201.729768:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1787378201.730273:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eebad230380/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787378201.730283:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626606976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787378201.830466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378201.830591:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604556416 00000100:00100000:2.0:1787378201.830606:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604556416 00000100:00100000:2.0:1787378201.830689:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1787378201.830703:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:10363:x1874201604556416:12345-192.168.203.22@tcp:36:truncate.0 00010000:00010000:2.0:1787378201.831193:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378201.831248:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e9e expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.831297:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:2.0:1787378201.831303:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378201.835219:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.835258:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.835274:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378201.835438:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787378201.835502:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052aaee04 reply state 00000000b8f713f3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378201.835514:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378201.835700:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10363:x1874201604556416:12345-192.168.203.22@tcp:36:truncate.0 Request processed in 4993us (5242us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787378201.835711:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000020:00080000:2.0:1787378201.835749:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787378201.839652:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.839676:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.839684:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.839692:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378201.839907:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.839919:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.839941:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:2.0:1787378201.839945:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378201.839951:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378201.839958:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853086 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378201.961479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378201.961973:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604556544 00000100:00100000:0.0:1787378201.961987:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604556544 00000100:00100000:0.0:1787378201.962066:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1787378201.962246:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:10377:x1874201604556544:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:0.0:1787378201.962284:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378201.962311:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785308d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ea5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.962398:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.962425:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.962447:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.962643:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.962654:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.962662:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.966309:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.966343:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.966358:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378201.967235:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787378201.967244:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787378201.967290:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967308:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967322:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967329:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967361:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967369:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378201.967374:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967384:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967400:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:0.0:1787378201.967405:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378201.967422:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967430:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853094 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967461:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967468:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967474:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967480:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378201.967699:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967775:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967787:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378201.967790:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378201.967794:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967800:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785309b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967859:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d785308d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967876:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378201.967885:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378201.967888:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378201.967891:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b600, rc 0) 00000100:00100000:0.0:1787378201.968022:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10377:x1874201604556544:12345-192.168.203.22@tcp:101:stat.0 Request processed in 5943us (6556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378201.968034:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1787378202.059402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378202.059565:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604556800 00000100:00100000:1.0:1787378202.059584:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604556800 00000100:00100000:1.0:1787378202.059683:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:1.0:1787378202.059696:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10387:x1874201604556800:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378202.059787:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378202.059818:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78530a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6eac expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378202.060703:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787378202.061126:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78530a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eac expref: 15 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378202.061146:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:1.0:1787378202.061149:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787378202.061155:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78530a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eac expref: 15 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378202.061176:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547200, rc 0) 00000100:00100000:1.0:1787378202.062152:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10387:x1874201604556800:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2450us (2753us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787378202.062165:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:1.0:1787378202.067867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378202.068134:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604557056 00000100:00100000:2.0:1787378202.068150:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604557056 00000100:00100000:2.0:1787378202.068235:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:2.0:1787378202.068248:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10387:x1874201604557056:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787378202.068912:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10387:x1874201604557056:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 664us (1057us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787378202.068924:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:2.0:1787378202.150190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378202.150409:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604557312 00000100:00100000:3.0:1787378202.150424:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604557312 00000100:00100000:3.0:1787378202.150507:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1787378202.150520:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10393:x1874201604557312:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787378202.150574:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378202.150602:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78530b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6eb3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.150985:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.151005:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.151015:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.151055:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.151070:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 16 pid: 5792 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378202.151086:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad231c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626607104:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378202.151270:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb85693480 going to sleep for 11 seconds 00000100:00100000:3.0:1787378202.162440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378202.162555:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604557440 00000100:00100000:2.0:1787378202.162569:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604557440 00010000:00010000:2.0:1787378202.162623:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 17 pid: 5792 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378202.162681:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1787378202.162693:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad232680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:2354:x1874201604557440:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378202.162786:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378202.162795:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 17 pid: 5792 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.162811:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 17 pid: 5792 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.162841:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:2.0:1787378202.162847:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.162858:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.162866:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.162890:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378202.162980:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad232680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:2354:x1874201604557440:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 288us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378202.162989:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00010000:00010000:0.0:1787378202.164131:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ea5 expref: 16 pid: 5792 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378202.164158:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad231c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626607104:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378202.164203:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.164214:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.164220:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378202.164255:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787378202.164472:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78530b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.164489:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.166194:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378202.166204:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787378202.166210:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05a00, rc 0) 00000100:00100000:0.0:1787378202.166334:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:10393:x1874201604557312:12345-192.168.203.22@tcp:101:bash.0 Request processed in 15811us (16156us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787378202.166346:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1787378202.173395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378202.173663:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604557696 00000100:00100000:2.0:1787378202.173677:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604557696 00000100:00100000:2.0:1787378202.174205:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:2.0:1787378202.174220:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:10393:x1874201604557696:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1787378202.174604:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.174627:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.174659:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378202.174775:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787378202.174804:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eeb054ae reply state 00000000ab758c59 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378202.174815:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378202.174947:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10393:x1874201604557696:12345-192.168.203.22@tcp:36:bash.0 Request processed in 729us (3238us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787378202.174956:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000020:00080000:2.0:1787378202.174966:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787378202.182623:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.182641:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.182671:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.182678:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378202.182683:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.182691:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.182709:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:3.0:1787378202.182711:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378202.182715:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.182732:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d78530cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378202.200022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378202.200170:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604557824 00000100:00100000:0.0:1787378202.200188:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604557824 00000100:00100000:0.0:1787378202.200301:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1787378202.200313:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:10393:x1874201604557824:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378202.200349:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378202.200377:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6eba expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.200515:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.200533:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.200543:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.200588:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.200606:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 19 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378202.200623:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626607232:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378202.200813:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378202.207213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378202.207253:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626607232:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378202.207413:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378202.207448:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604557952 00000100:00100000:2.0:1787378202.207457:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604557952 00010000:00010000:2.0:1787378202.207633:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 20 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378202.207688:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1787378202.207700:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:2354:x1874201604557952:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378202.207763:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378202.207773:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 20 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.207787:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 20 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.207817:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78530be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eb3 expref: 20 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.207865:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:2.0:1787378202.207871:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.207882:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.207892:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.207924:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378202.207960:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.207968:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378202.208019:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:2354:x1874201604557952:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 317us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378202.208027:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000004:00200000:0.0:1787378202.208038:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787378202.208049:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787378202.208078:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.208116:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78530d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eba expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.208133:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eba expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.208141:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378202.208144:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378202.208147:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128aa00, rc 0) 00000100:00100000:0.0:1787378202.208185:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:10393:x1874201604557824:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7876us (8174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378202.208193:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:1.0:1787378202.213035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378202.213192:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604558208 00000100:00100000:2.0:1787378202.213207:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604558208 00000100:00100000:2.0:1787378202.213293:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787378202.213305:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:10393:x1874201604558208:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1787378202.213809:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10393:x1874201604558208:12345-192.168.203.22@tcp:35:bash.0 Request processed in 504us (788us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787378202.213819:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1787378202.380511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378202.380696:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604558464 00000100:00100000:3.0:1787378202.380709:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604558464 00000100:00100000:3.0:1787378202.380842:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:3.0:1787378202.380853:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10403:x1874201604558464:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378202.380885:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378202.380912:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ec1 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378202.381268:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787378202.381611:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ec1 expref: 21 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.381637:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:3.0:1787378202.381640:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787378202.381647:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ec1 expref: 21 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.381663:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04600, rc 0) 00000100:00100000:3.0:1787378202.381847:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10403:x1874201604558464:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 994us (1350us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787378202.381857:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1787378202.391631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378202.391799:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604558592 00000100:00100000:3.0:1787378202.391812:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604558592 00000100:00100000:3.0:1787378202.391885:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:3.0:1787378202.391896:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10403:x1874201604558592:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1787378202.392000:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.392021:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.392037:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.392055:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.392063:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.392102:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393758:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393777:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393789:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787378202.393852:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393868:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393875:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393882:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393889:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378202.393894:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393902:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393917:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378202.393929:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378202.393936:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393943:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78530ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393958:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393965:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393971:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393976:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378202.393979:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393985:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.393992:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb97cb4600) 00010000:00010000:3.0:1787378202.393994:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378202.393997:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.394002:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78530f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.394017:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.394028:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.394035:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.394040:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378202.394043:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.394049:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.394055:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:3.0:1787378202.394057:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378202.394060:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.395041:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78530fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378202.395170:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10403:x1874201604558592:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 3270us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378202.395183:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1787378202.399802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378202.400180:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604558848 00000100:00100000:1.0:1787378202.400193:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604558848 00000100:00100000:1.0:1787378202.400281:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787378202.400300:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10403:x1874201604558848:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378202.401049:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10403:x1874201604558848:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 747us (1258us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787378202.401059:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787378202.468463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378202.468842:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604559104 00000100:00100000:0.0:1787378202.468856:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604559104 00000100:00100000:0.0:1787378202.468933:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1787378202.468945:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10406:x1874201604559104:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378202.469863:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378202.469897:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ec8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.470176:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.470218:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.470243:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.470263:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.470271:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.470278:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.474770:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.474796:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.474811:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378202.474826:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787378202.474972:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.474982:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.474989:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475005:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378202.475010:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475019:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475034:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:0.0:1787378202.475038:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378202.475043:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475050:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d785310b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475066:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475073:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475080:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475085:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378202.475088:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475094:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475112:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378202.475115:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378202.475117:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475123:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853112 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475188:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ec8 expref: 24 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475204:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ec8 expref: 23 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.475212:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378202.475214:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378202.475217:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:0.0:1787378202.475334:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:10406:x1874201604559104:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 6389us (6886us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787378202.475346:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1787378202.483825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378202.483971:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604559232 00000100:00100000:3.0:1787378202.483985:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604559232 00000100:00100000:3.0:1787378202.484063:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1787378202.484076:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:10406:x1874201604559232:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:3.0:1787378202.484162:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484199:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484213:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484257:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484265:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484273:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484280:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378202.484285:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484292:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484307:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:3.0:1787378202.484310:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787378202.484316:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.484322:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378202.484420:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:10406:x1874201604559232:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 346us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378202.484436:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1787378202.486600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378202.486707:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604559488 00000100:00100000:1.0:1787378202.486771:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604559488 00000100:00100000:1.0:1787378202.486837:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787378202.486848:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:10406:x1874201604559488:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378202.487161:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:10406:x1874201604559488:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 313us (573us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787378202.487169:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1787378202.489616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378202.489873:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604559616 00000100:00100000:0.0:1787378202.489885:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604559616 00000100:00100000:0.0:1787378202.489965:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1787378202.489978:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:2355:x1874201604559616:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378202.490115:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378202.490150:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ec8 expref: 24 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.490189:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378202.490195:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378202.490302:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:2355:x1874201604559616:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 327us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378202.490310:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00010000:00010000:1.0:1787378202.585918:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378202.650415:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626607360:0@lo:400:kworker.0 00000100:00100000:2.0:1787378202.650527:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378202.650814:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626607360 00000100:00100000:3.0:1787378202.650824:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626607360 00000100:00100000:3.0:1787378202.650891:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787378202.650901:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626607360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651184:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626607616:0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651235:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378202.651267:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787378202.651273:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626607488:0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651295:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378202.651322:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626607744:0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651348:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378202.651379:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626607744 00000100:00100000:0.0:1787378202.651383:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626607744 00000100:00100000:0.0:1787378202.651427:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787378202.651434:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626607744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651471:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626607744:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378202.651490:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787378202.651515:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787378202.651554:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626607744:0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651580:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626607616 00000100:00100000:0.0:1787378202.651583:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626607616 00000100:00080000:0.0:1787378202.651597:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378202.651616:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626607488 00000100:00100000:0.0:1787378202.651628:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626607488 00000100:00100000:0.0:1787378202.651651:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787378202.651658:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626607616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651695:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626607616:12345-0@lo:400:kworker.0 Request processed in 37us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378202.651701:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787378202.651752:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626607616:0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651775:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787378202.651782:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626607488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.651817:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626607488:12345-0@lo:400:kworker.0 Request processed in 36us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378202.651823:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787378202.651848:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626607488:0@lo:400:kworker.0 00000100:00100000:1.0:1787378202.657924:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626608000:0@lo:400:kworker.0 00000100:00100000:1.0:1787378202.658032:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378202.658135:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626608000 00000100:00100000:1.0:1787378202.658144:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626608000 00000100:00100000:1.0:1787378202.658211:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787378202.658232:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626608000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378202.658338:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626608000:12345-0@lo:400:kworker.0 Request processed in 119us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378202.658347:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787378202.658396:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626608000:0@lo:400:kworker.0 00000100:00080000:0.0:1787378202.660477:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787378202.660505:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787378202.660536:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626607872:0@lo:400:kworker.0 00000100:00100000:0.0:1787378202.660629:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378202.660867:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626607872 00000100:00100000:1.0:1787378202.660877:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626607872 00000100:00100000:3.0:1787378202.660924:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626607360:12345-0@lo:400:kworker.0 Request processed in 10022us (10395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378202.660938:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787378202.661170:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787378202.661181:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626607872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378202.661470:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626607872:12345-0@lo:400:kworker.0 Request processed in 291us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378202.661477:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1787378202.662667:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378202.662781:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626607872:0@lo:400:kworker.0 00000100:00100000:2.0:1787378202.665539:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626607360:0@lo:400:kworker.0 00000100:00100000:2.0:1787378202.731411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378202.731651:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604559872 00000100:00100000:0.0:1787378202.731664:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604559872 00000100:00100000:0.0:1787378202.731783:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1787378202.731795:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:10424:x1874201604559872:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1787378202.731830:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378202.731858:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785312e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ecf expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.732020:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853135 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.732039:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853135 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.732053:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853135 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378202.732066:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787378202.732291:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785312e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ecf expref: 26 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.732314:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853135 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ecf expref: 25 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378202.732323:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:0.0:1787378202.732327:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787378202.732331:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a000, rc 0) 00000100:00100000:0.0:1787378202.732667:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10424:x1874201604559872:12345-192.168.203.22@tcp:101:cat.0 Request processed in 872us (1279us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787378202.732676:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:3.0:1787378202.836546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378202.836782:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604560000 00000100:00100000:1.0:1787378202.836796:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604560000 00000100:00100000:1.0:1787378202.836884:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:1.0:1787378202.836895:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10425:x1874201604560000:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378202.837057:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378202.837086:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7853143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ed6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378202.837178:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785314a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378202.837195:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785314a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378202.837210:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785314a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378202.841377:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787378202.841384:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378202.841506:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785314a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.841558:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7853143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ed6 expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.841586:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785314a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ed6 expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.841595:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378202.841598:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378202.841602:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546e00, rc 0) 00000100:00100000:3.0:1787378202.841705:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10425:x1874201604560000:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 4810us (5176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378202.841716:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:2.0:1787378202.847709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378202.848244:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604560384 00000100:00100000:1.0:1787378202.848259:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604560384 00000100:00100000:1.0:1787378202.848366:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1787378202.848379:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10425:x1874201604560384:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378202.848985:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10425:x1874201604560384:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 606us (1290us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787378202.848995:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1787378202.857387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378202.857528:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604560512 00000100:00100000:3.0:1787378202.857542:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604560512 00000100:00100000:3.0:1787378202.857624:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:3.0:1787378202.857636:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10425:x1874201604560512:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:3.0:1787378202.857654:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787378202.857684:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78530da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eba expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.857711:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853135 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ecf expref: 26 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.857780:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7852fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e7b expref: 25 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.857797:0:8358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524500) 00010000:00010000:3.0:1787378202.857810:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378202.857876:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:10425:x1874201604560512:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 242us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378202.857884:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1787378202.872697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378202.872886:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604560640 00000100:00100000:3.0:1787378202.872899:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604560640 00000100:00100000:3.0:1787378202.872974:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:3.0:1787378202.872986:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:10425:x1874201604560640:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:3.0:1787378202.873166:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.873188:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378202.873217:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787378202.874206:0:9982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787378202.875165:0:9982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787378202.875269:0:9982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787378202.875582:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:10425:x1874201604560640:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 2589us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378202.875596:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:0.0:1787378202.940297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378202.940411:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604560768 00000100:00100000:2.0:1787378202.940432:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604560768 00000100:00100000:2.0:1787378202.940518:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1787378202.940530:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:10427:x1874201604560768:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378202.940559:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378202.940587:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853158 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6edd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.940680:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.940698:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.940711:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.940760:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.940770:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.940777:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941617:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941631:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941639:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378202.941686:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787378202.941691:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378202.941715:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941758:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941769:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941776:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941784:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941790:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378202.941795:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.941803:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942018:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378202.942021:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378202.942028:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942034:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d785315f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942051:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942058:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942063:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942068:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378202.942071:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942077:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942084:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeba261e200) 00010000:00010000:2.0:1787378202.942086:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378202.942089:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942095:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942157:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853158 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942174:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 25 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378202.942182:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb97cb4600) 00010000:00010000:2.0:1787378202.942184:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378202.942188:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7200, rc 0) 00000100:00100000:2.0:1787378202.942349:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10427:x1874201604560768:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1820us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378202.942360:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:0.0:1787378203.162039:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787378203.162074:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb8455aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626608128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378203.162200:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378203.162303:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626608128 00000100:00100000:0.0:1787378203.162313:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626608128 00000100:00100000:0.0:1787378203.162380:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787378203.162402:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626608128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378203.162462:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378203.162516:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626608128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378203.162525:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787378203.162584:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb8455aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626608128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378203.165629:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626608256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378203.165734:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378203.165962:0:11748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626608256 00000100:00100000:1.0:1787378203.165972:0:11748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626608256 00000100:00100000:1.0:1787378203.166046:0:11748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787378203.166058:0:11748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626608256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378203.166104:0:11748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787378203.166156:0:11748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626608256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378203.166164:0:11748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787378203.166228:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626608256:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787378203.227969:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787378203.227984:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787378203.228065:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787378203.228073:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787378203.228265:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb8455aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626608384:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787378203.228390:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729240 going to sleep for 11 seconds 00000100:00100000:2.0:1787378203.234335:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb8455aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626608384:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787378203.234779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.234882:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604560896 00000100:00100000:0.0:1787378203.234892:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604560896 00000100:00100000:0.0:1787378203.234979:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787378203.234991:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10438:x1874201604560896:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 00000100:00080000:2.0:1787378203.235087:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378203.235213:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10438:x1874201604560896:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 Request processed in 223us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378203.235232:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787378203.237597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378203.237851:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604561024 00000100:00100000:3.0:1787378203.237864:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604561024 00000100:00100000:3.0:1787378203.237934:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:3.0:1787378203.237946:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10438:x1874201604561024:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787378203.237985:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787378203.238139:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10438:x1874201604561024:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 194us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378203.238147:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:2.0:1787378203.247952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378203.248107:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604561152 00000100:00100000:3.0:1787378203.248122:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604561152 00000100:00100000:3.0:1787378203.248205:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1787378203.248228:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10438:x1874201604561152:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787378203.248338:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.248361:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.248378:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.250346:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.250385:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.250398:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.250436:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.250445:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.250451:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378203.251113:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787378203.251120:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378203.251134:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251147:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251154:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251161:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251167:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378203.251172:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251188:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251201:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:3.0:1787378203.251204:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378203.251209:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251223:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853174 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251239:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251244:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251250:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251255:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378203.251258:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251264:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251271:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9eeb97cb4700) 00010000:00010000:3.0:1787378203.251274:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378203.251277:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251293:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785317b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251308:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251315:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251321:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251325:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378203.251328:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251334:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251341:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb97cb4600) 00010000:00010000:3.0:1787378203.251343:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378203.251345:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.251351:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853182 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.251442:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10438:x1874201604561152:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 3223us (3502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378203.251452:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:0.0:1787378203.263980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.264040:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604561408 00000100:00100000:0.0:1787378203.264211:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604561408 00000100:00100000:0.0:1787378203.264369:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:0.0:1787378203.264384:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:10438:x1874201604561408:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378203.264414:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378203.264440:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853189 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ee4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.264569:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.264588:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.264602:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378203.264954:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787378203.265379:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265390:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265397:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265405:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378203.265410:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265418:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265445:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb97cb4600) 00010000:00010000:0.0:1787378203.265448:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787378203.265454:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265460:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265523:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853189 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ee4 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265537:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:0.0:1787378203.265540:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378203.265544:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853189 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ee4 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.265556:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:0.0:1787378203.265981:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10438:x1874201604561408:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1599us (2015us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787378203.265993:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:1.0:1787378203.283345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.283465:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604561536 00000100:00100000:0.0:1787378203.283488:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604561536 00000100:00100000:0.0:1787378203.283560:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:0.0:1787378203.283574:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10438:x1874201604561536:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787378203.283625:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787378203.283786:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10438:x1874201604561536:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 214us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378203.283815:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:2.0:1787378203.294522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378203.294656:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604561792 00000100:00100000:3.0:1787378203.294669:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604561792 00000100:00100000:3.0:1787378203.294771:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:3.0:1787378203.294784:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10438:x1874201604561792:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787378203.294811:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378203.294816:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787378203.294852:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785314a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ed6 expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.294876:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378203.294883:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378203.294899:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785319e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6eeb expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787378203.306989:0:9982:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787378203.307657:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78531a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.307678:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78531a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.307693:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78531a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.307814:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d785319e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eeb expref: 28 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.307836:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78531a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eeb expref: 27 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.307846:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378203.307850:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378203.307855:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:0.0:1787378203.307948:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10438:x1874201604561792:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 13165us (13437us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787378203.307959:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:1.0:1787378203.320654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.320774:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604562048 00000100:00100000:0.0:1787378203.320788:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604562048 00000100:00100000:0.0:1787378203.320875:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:0.0:1787378203.320887:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10438:x1874201604562048:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787378203.320991:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378203.321028:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78531a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6eeb expref: 27 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.321053:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378203.321067:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378203.321098:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.321114:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.321125:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.324892:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.324917:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.324933:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.328926:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.328949:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.328971:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.328979:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378203.328985:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.328995:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329029:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:1.0:1787378203.329034:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378203.329039:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329046:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78531b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329065:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329072:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329078:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329083:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378203.329086:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329102:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329111:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x88728f26 (ffff9eeb829cdd00) 00010000:00010000:1.0:1787378203.329113:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378203.329116:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.329122:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d78531ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x88728f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378203.329282:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10438:x1874201604562048:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 8389us (8634us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787378203.329294:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:1.0:1787378203.334067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.334152:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604562176 00000100:00100000:0.0:1787378203.334169:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604562176 00000100:00100000:0.0:1787378203.334245:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:0.0:1787378203.334255:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10438:x1874201604562176:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378203.334277:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378203.334302:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78531c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ef2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.334353:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.334365:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.334377:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.334465:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78531c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.334483:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.334492:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378203.334495:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787378203.334499:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128be00, rc 0) 00000100:00100000:0.0:1787378203.334573:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10438:x1874201604562176:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 320us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378203.334581:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:3.0:1787378203.337778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378203.339563:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604562432 00000100:00100000:1.0:1787378203.339580:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604562432 00000100:00100000:1.0:1787378203.339660:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:1.0:1787378203.339670:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10438:x1874201604562432:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787378203.339789:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.339807:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.339821:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787378203.340118:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787378203.340205:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339602484203ns, next at 340602481627ns, rc = 0 00000004:00010000:1.0:1787378203.340302:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000707487d2 reply state 00000000539c07f3 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378203.340312:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787378203.340422:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10438:x1874201604562432:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 752us (2659us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787378203.340433:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00010000:00010000:2.0:1787378203.344049:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.344074:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.344082:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.344089:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378203.344094:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.344124:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.344148:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:2.0:1787378203.344165:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787378203.344172:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.344180:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d78531cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.344605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378203.344711:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604562560 00000100:00100000:2.0:1787378203.344769:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604562560 00000100:00100000:2.0:1787378203.344840:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:2.0:1787378203.344851:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:10438:x1874201604562560:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378203.344885:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378203.344912:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ef9 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.344997:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 29 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.345015:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 29 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.345038:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:2.0:1787378203.345041:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378203.345044:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6400, rc 0) 00000100:00100000:2.0:1787378203.345134:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10438:x1874201604562560:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 284us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378203.345143:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:0.0:1787378203.353510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378203.358305:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604562688 00000100:00100000:2.0:1787378203.358325:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604562688 00000100:00100000:2.0:1787378203.358397:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1787378203.358409:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1874201604562688:12345-192.168.203.22@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787378203.358476:0:8120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:2.0:1787378203.358522:0:8120:0:(genops.c:1406:class_connect()) connect: client 3ca7eed4-13a1-4f52-9d12-97b20fe7905e, cookie 0xdd3c5462d78531dd 00002000:00100000:2.0:1787378203.358541:0:8120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ca7eed4-13a1-4f52-9d12-97b20fe7905e/ffff9eebbb3c0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787378203.358558:0:8120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787378203.358926:0:8120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787378203.358973:0:8120:0:(import.c:65:import_set_state_nolock()) ffff9eebbb3c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378203.359075:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2352:x1874201604562688:12345-192.168.203.22@tcp:8:lhsmtool_posix.0 Request processed in 665us (5573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378203.359090:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787378203.363003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.363055:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604562816 00000100:00100000:0.0:1787378203.363066:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604562816 00000100:00100000:0.0:1787378203.363143:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1787378203.363172:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:0:x1874201604562816:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787378203.364714:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787378203.429040:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:0:x1874201604562816:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 65871us (66034us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787378203.429057:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000001:00080000:2.0:1787378203.429104:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1787378203.429118:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000100:00100000:3.0:1787378203.434633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.435562:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604563072 00000100:00100000:0.0:1787378203.435579:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604563072 00000100:00100000:0.0:1787378203.435838:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1787378203.435852:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10438:x1874201604563072:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787378203.436166:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:10438:x1874201604563072:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 316us (1547us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787378203.441168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378203.442696:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604563328 00000100:00100000:2.0:1787378203.442713:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604563328 00000100:00100000:2.0:1787378203.442816:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:2.0:1787378203.442826:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10438:x1874201604563328:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787378203.443005:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10438:x1874201604563328:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 179us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378203.443014:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:0.0:1787378203.443668:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1787378203.448704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.449102:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604563456 00000100:00100000:0.0:1787378203.449117:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604563456 00000100:00100000:0.0:1787378203.449236:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:0.0:1787378203.449248:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:10438:x1874201604563456:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378203.449279:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378203.449306:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78531e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f00 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.449401:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78531eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.449419:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78531eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.449434:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78531eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378203.449494:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787378203.449517:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78531eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.449574:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78531e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f00 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.449595:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78531eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f00 expref: 31 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.449605:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378203.449608:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787378203.449613:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128aa00, rc 0) 00000100:00100000:0.0:1787378203.449703:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10438:x1874201604563456:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 457us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378203.449712:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:2.0:1787378203.456871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.456961:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604563584 00000100:00100000:0.0:1787378203.456975:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604563584 00000100:00100000:0.0:1787378203.457054:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1787378203.457067:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604563584:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378203.457093:0:8120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378203.457126:0:8120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f07 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378203.457163:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a893a1b, blocks: 0x1 00010000:00010000:0.0:1787378203.457190:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1787378203.457196:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378203.457208:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 6 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.457269:0:8120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 6 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.457286:0:8120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:0.0:1787378203.457358:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604563584:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 292us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378203.457365:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1787378203.461182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378203.461296:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604563840 00000100:00100000:2.0:1787378203.461308:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604563840 00000100:00100000:2.0:1787378203.461387:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:2.0:1787378203.461399:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10438:x1874201604563840:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787378203.461552:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10438:x1874201604563840:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 154us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378203.461561:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:3.0:1787378203.469556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.469775:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604563968 00000100:00100000:0.0:1787378203.469788:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604563968 00000100:00100000:0.0:1787378203.469863:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:0.0:1787378203.469875:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:10438:x1874201604563968:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378203.469898:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378203.469923:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f0e expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.469960:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 7 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.469969:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378203.469974:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378203.469981:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.470022:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 7 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.470048:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 7 pid: 8120 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378203.470066:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626608512:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378203.470190:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb900b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787378203.484092:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626608512:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378203.484164:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.484193:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a600, rc 0) 00000100:00100000:3.0:1787378203.484286:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:10438:x1874201604563968:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 14411us (14743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378203.484310:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:0.0:1787378203.493112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378203.493204:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604564096 00000100:00100000:3.0:1787378203.493226:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604564096 00010000:00010000:3.0:1787378203.493285:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 7 pid: 8120 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.493333:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1787378203.493346:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604564096:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378203.493365:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378203.493398:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 7 pid: 8120 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.493414:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 7 pid: 8120 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.493445:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109602d8/0xdd3c5462d78531f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f07 expref: 7 pid: 8120 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.493465:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378203.493470:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378203.493480:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.493493:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.493565:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.493584:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5777:1874201626608640:192.168.203.22@tcp:105: 00000100:00100000:3.0:1787378203.493687:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb85693a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378203.503813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.503937:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604564224 00000100:00100000:0.0:1787378203.503952:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604564224 00002000:00100000:0.0:1787378203.504022:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9eeb881f1500 x1874201604564224/t0(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:274/0 lens 504/0 e 0 to 0 dl 1787378214 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378203.504035:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb881f1500 with x1874201604564224 ext(0->8) 00002000:00010000:0.0:1787378203.504043:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eeb881f1500 00000100:00100000:0.0:1787378203.504087:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1787378203.504098:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604564224:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787378203.508531:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2353:x1874201604564224:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 4417us (4717us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787378203.508552:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00002000:00100000:0.0:1787378203.508568:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9eeb881f1500 x1874201604564224/t4294967302(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:274/0 lens 504/448 e 0 to 0 dl 1787378214 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378203.508581:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb881f1500 with x1874201604564224 ext(0->8) 00002000:00010000:0.0:1787378203.508590:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eeb881f1500 00000100:00100000:3.0:1787378203.509531:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5777:1874201626608640:192.168.203.22@tcp:105: 00010000:00010000:3.0:1787378203.509566:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378203.509614:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604564096:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 16269us (16514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378203.509625:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:2.0:1787378203.515544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378203.515636:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604564352 00000100:00100000:3.0:1787378203.515651:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604564352 00000100:00100000:3.0:1787378203.515772:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:3.0:1787378203.515786:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10438:x1874201604564352:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787378203.610352:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378203.637851:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10438:x1874201604564352:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 122051us (122306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378203.637886:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000001:00080000:1.0:1787378203.638029:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787378203.638062:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787378203.638079:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1787378203.640482:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626608768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787378203.640576:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787378203.640752:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787378203.640768:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787378203.645791:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626608768 00000100:00100000:1.0:1787378203.645811:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626608768 00000100:00100000:1.0:1787378203.645882:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787378203.645894:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626608768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787378203.647520:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787378203.647531:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787378203 00002000:00010000:1.0:1787378203.647534:0:8120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787378203.647537:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787378203 -> 1787378203 00002000:00010000:1.0:1787378203.647539:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787378203.647658:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874201626608768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1763us (7079us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787378203.647670:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1787378203.647942:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eebbb3dbb80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787378203.647951:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626608768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787378203.652165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378203.652370:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604564480 00000100:00100000:1.0:1787378203.652384:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604564480 00000100:00100000:1.0:1787378203.652450:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:1.0:1787378203.652461:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604564480:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787378203.728883:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787378203.728913:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1787378203.729152:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604564480:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 76684us (76995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378203.729167:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:2.0:1787378203.734980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.735593:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604564736 00000100:00100000:0.0:1787378203.735608:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604564736 00000100:00100000:0.0:1787378203.736138:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:0.0:1787378203.736154:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10438:x1874201604564736:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787378203.736707:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378203.736775:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78531eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f00 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.736799:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378203.736806:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378203.736848:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.736866:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.736878:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378203.737809:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d8c49cc reply state 0000000065f80130 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378203.737843:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787378203.737998:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10438:x1874201604564736:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1847us (3340us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787378203.738017:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00010000:00010000:3.0:1787378203.741445:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.741465:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.741482:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.741512:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378203.741519:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.741527:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.741548:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:3.0:1787378203.741551:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378203.741555:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.741562:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853200 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378203.742585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.742936:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604564864 00000100:00100000:0.0:1787378203.742949:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604564864 00000100:00100000:0.0:1787378203.743098:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787378203.743109:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604564864:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787378203.743448:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787378203.743453:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787378203 -> 1787378202 00002000:00010000:0.0:1787378203.743455:0:8120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787378200 00002000:00010000:0.0:1787378203.743458:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787378203 -> 1787378202 00002000:00010000:0.0:1787378203.743460:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787378203.743544:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604564864:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 435us (968us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787378203.743552:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:1.0:1787378203.753537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378203.753618:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604565120 00000100:00100000:3.0:1787378203.753632:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604565120 00000100:00100000:3.0:1787378203.753744:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:3.0:1787378203.753757:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10438:x1874201604565120:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787378203.753852:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.753873:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.753885:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.753931:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.753965:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 13 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.753983:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626608896:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378203.754108:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb856930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378203.759753:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626608896:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378203.759794:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.760518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378203.761049:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604565248 00000100:00100000:2.0:1787378203.761061:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604565248 00010000:00010000:2.0:1787378203.761112:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 14 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378203.761170:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:2.0:1787378203.761180:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:2354:x1874201604565248:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378203.761199:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378203.761206:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 14 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.761234:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 14 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.761264:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78531c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef2 expref: 14 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.761284:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:2.0:1787378203.761290:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.761301:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.761308:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.761337:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378203.761399:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:2354:x1874201604565248:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 220us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378203.761406:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00010000:00010000:2.0:1787378203.761434:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.761448:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.762061:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.762071:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.762077:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.762082:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378203.762086:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.762094:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.762103:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:2.0:1787378203.762106:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787378203.762109:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.762114:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853207 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378203.762224:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:10438:x1874201604565120:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 8459us (8692us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787378203.762234:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:0.0:1787378203.766551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378203.766854:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604565376 00000100:00100000:3.0:1787378203.766867:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604565376 00000100:00100000:3.0:1787378203.766971:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:3.0:1787378203.766984:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604565376:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787378203.767059:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.767086:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.767096:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787378203.767102:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378203.767107:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.767156:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.767173:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 7 pid: 6588 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.767222:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626609024:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378203.767334:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb85693b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378203.770614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378203.770832:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626609024:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378203.770868:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.770978:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604565504 00000100:00100000:3.0:1787378203.770987:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604565504 00010000:00010000:3.0:1787378203.771102:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 8 pid: 6588 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.771190:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1787378203.771202:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604565504:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378203.771231:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378203.771264:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 8 pid: 6588 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.771277:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 8 pid: 6588 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.771307:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d78531f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f0e expref: 8 pid: 6588 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.771327:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378203.771331:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378203.771337:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.771369:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.771394:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378203.771450:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604565504:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 251us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378203.771457:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00010000:00010000:1.0:1787378203.771796:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.771808:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.771840:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.771850:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.771859:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.771868:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378203.771874:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.771885:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.771914:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.771923:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f2b0a3b/0xdd3c5462d785320e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378203.771990:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604565376:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 5008us (5453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378203.772011:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1787378203.782317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378203.785140:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604565760 00000100:00100000:1.0:1787378203.785160:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604565760 00000100:00100000:0.0:1787378203.787979:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:0.0:1787378203.787994:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:10438:x1874201604565760:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787378203.788119:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.788139:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.788152:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.788487:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.788499:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 13 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.788508:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.788549:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 13 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.788565:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 13 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378203.788581:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626609152:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378203.789234:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb900b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787378203.792783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378203.792869:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604565888 00000100:00100000:2.0:1787378203.792882:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604565888 00010000:00010000:2.0:1787378203.792940:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 14 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378203.792992:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1787378203.793013:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:2354:x1874201604565888:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378203.793037:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378203.793045:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 14 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.793061:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 14 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.793093:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:2.0:1787378203.793100:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.793111:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.793120:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.793144:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378203.793208:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:2354:x1874201604565888:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 205us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378203.793226:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00010000:00010000:3.0:1787378203.794464:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78531d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ef9 expref: 13 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.794502:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626609152:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378203.794534:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.794544:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.794550:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378203.797349:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787378203.797631:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787378203.797702:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787378203.798121:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874201626609280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787378203.798238:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378203.798289:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787378203.798516:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626609280 00000100:00100000:3.0:1787378203.798528:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626609280 00000100:00100000:3.0:1787378203.798602:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787378203.798614:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1874201626609280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787378203.798760:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1874201626609280:12345-0@lo:1000:mdt00_001.0 Request processed in 147us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378203.798777:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787378203.798878:0:5791:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787378203.798886:0:5791:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eebbb3dbb80, transno 4294967303 00000100:00100000:1.0:1787378203.798909:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874201626609280:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787378203.799423:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787378203.799508:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874201626609408:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787378203.799559:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378203.799581:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb905ff840 going to sleep for 11 seconds 00000100:00100000:2.0:1787378203.799849:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626609408 00000100:00100000:2.0:1787378203.799856:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626609408 00000100:00100000:2.0:1787378203.799892:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378203.799899:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5791:x1874201626609408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787378203.800916:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5791:x1874201626609408:12345-0@lo:1000:mdt00_001.0 Request processed in 1011us (1350us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787378203.801269:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874201626609408:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787378203.801322:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801335:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801358:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801365:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378203.801371:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801380:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801399:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:1.0:1787378203.801403:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378203.801408:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801415:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785321c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801462:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378203.801595:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787378203.801664:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801672:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801678:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378203.801681:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801698:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801708:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb97cb4600) 00010000:00010000:1.0:1787378203.801711:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378203.801715:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801746:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853151 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801799:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801815:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801825:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801862:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378203.801877:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 16 pid: 5790 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378203.801892:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626609536:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378203.801984:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb905ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378203.806556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378203.806646:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604566016 00000100:00100000:3.0:1787378203.806666:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604566016 00010000:00010000:3.0:1787378203.806751:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 17 pid: 5790 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378203.806792:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1787378203.806803:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:2354:x1874201604566016:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378203.806820:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378203.806827:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 17 pid: 5790 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.806842:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 17 pid: 5790 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.806870:0:8358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb97cb4600) 00010000:00010000:3.0:1787378203.806876:0:8358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.806886:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.806895:0:8358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378203.806915:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378203.806978:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:2354:x1874201604566016:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 177us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378203.806995:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00010000:00010000:2.0:1787378203.807968:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785316d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6edd expref: 16 pid: 5790 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378203.807987:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626609536:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378203.808021:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808030:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808036:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808050:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808055:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808071:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808076:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378203.808081:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808089:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808101:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb97cb4600) 00010000:00010000:2.0:1787378203.808103:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378203.808107:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808112:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853223 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808122:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808128:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808133:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808137:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378203.808139:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808152:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808160:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb97cb4600) 00010000:00010000:2.0:1787378203.808163:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787378203.808166:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.808172:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853215 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378203.808509:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10438:x1874201604565760:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 20515us (26207us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787378203.808520:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000020:00080000:2.0:1787378203.808525:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787378203.814104:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787378203.814117:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787378203.814149:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787378203.814175:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787378203.815336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378203.816799:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604566272 00000100:00100000:2.0:1787378203.816817:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604566272 00000100:00100000:2.0:1787378203.816899:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1787378203.816910:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10438:x1874201604566272:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787378203.818860:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787378203.818967:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787378203.819105:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.819125:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.819137:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.819530:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.819537:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.819543:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378203.819569:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378203.819704:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787378203.819713:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:10438:x1874201604566272:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 2799us (4382us total) trans 4294967362 rc 0/0 00010000:00010000:0.0:1787378203.819713:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378203.819751:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000020:00080000:2.0:1787378203.819759:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787378203.819765:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378203.819770:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.819779:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.819793:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eeba261e700) 00010000:00010000:0.0:1787378203.819797:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787378203.819801:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.819807:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785322a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378203.819826:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378203.819829:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378203.819830:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787378204.099943:0:11850:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787378204.099961:0:11850:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787378204.100004:0:11850:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787378204.100010:0:11850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787378204.307095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378204.307369:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604566528 00000100:00100000:0.0:1787378204.307381:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604566528 00000100:00100000:0.0:1787378204.307452:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:0.0:1787378204.307462:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:10448:x1874201604566528:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378204.307488:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378204.307510:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f15 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.307785:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853238 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.307799:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.307816:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378204.307829:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787378204.308002:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d7853231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f15 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.308020:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f15 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.308028:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:0.0:1787378204.308031:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787378204.308034:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a200, rc 0) 00000100:00100000:0.0:1787378204.308103:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10448:x1874201604566528:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 642us (1016us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787378204.308111:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:0.0:1787378204.311447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378204.312561:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604566656 00000100:00100000:3.0:1787378204.312573:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604566656 00000100:00100000:3.0:1787378204.312636:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:3.0:1787378204.312645:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10448:x1874201604566656:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1787378204.312754:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.312773:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.312786:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.312802:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.312810:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.312816:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313127:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313136:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313144:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787378204.313195:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313220:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313227:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313234:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313241:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378204.313245:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313253:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313267:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378204.313270:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378204.313274:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313280:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853246 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313292:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313298:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313311:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313317:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378204.313320:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313327:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313337:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb97cb4700) 00010000:00010000:3.0:1787378204.313340:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378204.313342:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313348:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d785324d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313364:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313371:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313377:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313382:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378204.313384:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313402:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313412:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378204.313414:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378204.313417:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.313423:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d7853254 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378204.313514:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10448:x1874201604566656:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 867us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378204.313523:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:3.0:1787378204.392635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378204.393102:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604566912 00000100:00100000:2.0:1787378204.393112:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604566912 00000100:00100000:2.0:1787378204.393170:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:2.0:1787378204.393180:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10451:x1874201604566912:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378204.393203:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378204.393235:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785325b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f1c expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.393305:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.393336:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.393348:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.393364:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.393371:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.393377:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394115:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394128:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394137:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378204.394148:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787378204.394262:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394270:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394276:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394290:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378204.394295:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394302:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394314:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378204.394317:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378204.394322:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394328:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853262 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394341:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394346:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394351:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394357:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378204.394360:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394382:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394402:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeba261ed00) 00010000:00010000:2.0:1787378204.394405:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378204.394407:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.394413:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6600/0xdd3c5462d7853269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.395227:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d785325b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 22 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.395250:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 21 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.395258:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:3.0:1787378204.395260:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378204.395262:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6400, rc 0) 00000100:00100000:3.0:1787378204.395335:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10451:x1874201604566912:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2157us (2709us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787378204.395344:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:0.0:1787378204.403491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378204.403585:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604567040 00000100:00100000:1.0:1787378204.403595:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604567040 00000100:00100000:1.0:1787378204.403645:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:1.0:1787378204.403652:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10451:x1874201604567040:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:1.0:1787378204.403714:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403759:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403770:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403797:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403804:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403811:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403817:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378204.403821:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403828:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403857:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:1.0:1787378204.403860:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787378204.403865:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.403870:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785327e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378204.404038:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10451:x1874201604567040:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 384us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378204.404046:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:0.0:1787378204.411942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378204.412073:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604567296 00000100:00100000:3.0:1787378204.412096:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604567296 00000100:00100000:3.0:1787378204.412219:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1787378204.412229:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10451:x1874201604567296:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787378204.412448:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:10451:x1874201604567296:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 220us (514us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787378204.412455:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1787378204.453818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378204.453930:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604567552 00000100:00100000:0.0:1787378204.453940:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604567552 00000100:00100000:0.0:1787378204.454011:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:0.0:1787378204.454021:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:9982:x1874201604567552:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378204.454044:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378204.454064:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853285 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f23 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.454201:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.454226:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 23 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.454235:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.454269:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 23 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.454282:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 23 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378204.454295:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626609664:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378204.454393:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb900b2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378204.459281:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626609664:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378204.459315:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378204.460627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378204.461576:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604567680 00000100:00100000:2.0:1787378204.461586:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604567680 00010000:00010000:2.0:1787378204.461630:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 24 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378204.461671:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:2.0:1787378204.461680:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:2353:x1874201604567680:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378204.461694:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378204.461701:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 24 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.461714:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 24 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.461782:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d7853270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f1c expref: 24 pid: 9982 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.461799:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:2.0:1787378204.461803:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.461824:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.461831:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.461864:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378204.461912:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:2353:x1874201604567680:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 233us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378204.461919:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00010000:00010000:1.0:1787378204.464593:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.464611:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378204.464638:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787378204.464881:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853285 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 24 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.464901:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.464920:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:1.0:1787378204.464935:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787378204.464940:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128be00, rc 0) 00000100:00100000:1.0:1787378204.465001:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:9982:x1874201604567552:12345-192.168.203.22@tcp:101:bash.0 Request processed in 10981us (11192us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787378204.465020:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:3.0:1787378204.477596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378204.477941:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604567936 00000100:00100000:2.0:1787378204.477952:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604567936 00000100:00100000:2.0:1787378204.478179:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:2.0:1787378204.478190:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:9982:x1874201604567936:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1787378204.478547:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.478565:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.478577:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378204.478634:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787378204.478661:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a326697 reply state 00000000c41b0f07 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378204.478670:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787378204.478886:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787378204.479258:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:9982:x1874201604567936:12345-192.168.203.22@tcp:36:bash.0 Request processed in 1068us (1798us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787378204.479281:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000020:00080000:2.0:1787378204.479288:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787378204.482813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:2.0:1787378204.483199:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.483222:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.483229:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.483234:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378204.483238:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.483245:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.483261:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:2.0:1787378204.483264:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378204.483268:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.483273:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785329a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378204.483873:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604568064 00000100:00100000:3.0:1787378204.483884:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604568064 00000100:00100000:3.0:1787378204.484139:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:3.0:1787378204.484151:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:9982:x1874201604568064:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787378204.484175:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378204.484194:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78532a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f2a expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.484260:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78532a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f2a expref: 27 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.484274:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78532a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f2a expref: 27 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.484292:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:3.0:1787378204.484296:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787378204.484299:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04000, rc 0) 00000100:00100000:3.0:1787378204.484374:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:9982:x1874201604568064:12345-192.168.203.22@tcp:101:bash.0 Request processed in 225us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378204.484399:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:0.0:1787378204.488437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378204.488663:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604568192 00000100:00100000:2.0:1787378204.488672:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604568192 00000100:00100000:2.0:1787378204.488779:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1787378204.488790:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:9982:x1874201604568192:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787378204.488825:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378204.488851:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f31 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787378204.488881:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a893a1a, atime: 0x6a893a18, ctime: 0x6a893a1a, blocks: 0xb 00010000:00010000:2.0:1787378204.488903:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1787378204.488908:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378204.488916:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.488932:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.488944:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6600, rc 0) 00000100:00100000:2.0:1787378204.489029:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:9982:x1874201604568192:12345-192.168.203.22@tcp:101:bash.0 Request processed in 242us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378204.489036:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1787378204.493825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378204.494186:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604568320 00000100:00100000:1.0:1787378204.494198:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604568320 00002000:00010000:1.0:1787378204.494247:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787378204.494252:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb901f8a80 with x1874201604568320 ext(0->18446744073709551615) 00002000:00010000:1.0:1787378204.494264:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eeb901f8a80. 00000100:00100000:1.0:1787378204.494301:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1787378204.494311:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604568320:12345-192.168.203.22@tcp:10:bash.0 00002000:00010000:1.0:1787378204.494618:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787378204.494622:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787378202 -> 1787378204 00002000:00010000:1.0:1787378204.494625:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787378200 -> 1787378200 00002000:00010000:1.0:1787378204.494627:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787378202 -> 1787378204 00002000:00010000:1.0:1787378204.494630:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787378204.494697:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604568320:12345-192.168.203.22@tcp:10:bash.0 Request processed in 386us (880us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787378204.494705:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00002000:00010000:1.0:1787378204.494709:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787378204.494712:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb901f8a80 with x1874201604568320 ext(0->18446744073709551615) 00002000:00010000:1.0:1787378204.494758:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eeb901f8a80. 00000100:00100000:3.0:1787378204.577541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378204.578389:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604568448 00000100:00100000:1.0:1787378204.578407:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604568448 00000100:00100000:0.0:1787378204.578614:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:0.0:1787378204.578632:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10465:x1874201604568448:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1787378204.578711:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.578757:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.578783:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.578799:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.578806:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.578813:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579488:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579500:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579507:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378204.579549:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579561:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579568:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579575:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579591:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378204.579595:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579603:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579615:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:0.0:1787378204.579618:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378204.579621:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579628:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78532af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579641:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579647:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579654:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579659:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378204.579662:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579668:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579684:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378204.579687:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378204.579689:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579695:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78532b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579710:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579716:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579833:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579839:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378204.579842:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579848:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579857:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:0.0:1787378204.579859:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378204.579862:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.579869:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78532bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378204.579973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10465:x1874201604568448:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1346us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378204.579982:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:0.0:1787378204.626529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378204.626959:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604568704 00000100:00100000:1.0:1787378204.626973:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604568704 00000100:00100000:1.0:1787378204.627062:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:1.0:1787378204.627074:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:10468:x1874201604568704:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378204.627095:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378204.627117:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78532c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f38 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627188:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627201:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627223:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627238:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627245:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627251:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627583:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d78532d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627594:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d78532d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627602:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d78532d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378204.627623:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787378204.627715:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627780:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627788:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627794:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378204.627798:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627805:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627818:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:1.0:1787378204.627821:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378204.627825:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627831:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78532cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627845:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627852:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627868:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627872:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378204.627875:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627881:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627889:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb85524200) 00010000:00010000:1.0:1787378204.627891:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378204.627894:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627899:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d78532d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627945:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78532c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f38 expref: 30 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627959:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d78532d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f38 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.627966:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:1.0:1787378204.627968:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787378204.627971:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547c00, rc 0) 00000100:00100000:1.0:1787378204.628042:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10468:x1874201604568704:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 970us (1528us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787378204.628060:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:3.0:1787378204.633479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378204.633626:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604568832 00000100:00100000:2.0:1787378204.633640:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604568832 00000100:00100000:2.0:1787378204.633769:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:2.0:1787378204.633783:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10468:x1874201604568832:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1787378204.633881:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.633893:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378204.633903:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.633939:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.633985:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.634013:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 29 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378204.634032:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626609792:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378204.634160:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378204.636534:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626609792:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378204.636571:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378204.637110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378204.643357:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604569088 00000100:00100000:2.0:1787378204.643384:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604569088 00000100:00100000:2.0:1787378204.643616:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1787378204.643630:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:5568:x1874201604569088:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787378204.644106:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:5568:x1874201604569088:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 477us (6997us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787378204.644116:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1787378204.650802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378204.651140:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604569216 00000100:00100000:1.0:1787378204.651155:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604569216 00010000:00010000:1.0:1787378204.651219:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 31 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378204.651266:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:1.0:1787378204.651276:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:2353:x1874201604569216:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378204.651295:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378204.651303:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 31 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.651319:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 31 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.651346:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785328c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f23 expref: 31 pid: 5792 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.651367:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:1.0:1787378204.651373:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.651385:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.651395:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.651456:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378204.651545:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:2353:x1874201604569216:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 269us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378204.651554:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00010000:00010000:2.0:1787378204.652648:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.652663:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.652761:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.652770:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.652778:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.652785:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c6400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378204.652790:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.652799:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.652815:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:2.0:1787378204.652818:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378204.652823:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.652829:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d78532e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378204.652923:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10468:x1874201604568832:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 19139us (19467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378204.652935:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:3.0:1787378204.655031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378204.655138:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604569472 00000100:00100000:0.0:1787378204.655152:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604569472 00000100:00100000:0.0:1787378204.655240:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1787378204.655253:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:10468:x1874201604569472:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787378204.655627:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:10468:x1874201604569472:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 375us (608us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787378204.655636:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1787378204.752968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378204.753121:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604569728 00000100:00100000:3.0:1787378204.753135:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604569728 00000100:00100000:3.0:1787378204.753224:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:3.0:1787378204.753236:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:10479:x1874201604569728:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:3.0:1787378204.753273:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378204.753302:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78532ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f3f expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.753400:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.753419:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.753435:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.753453:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.753460:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.753555:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.754925:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.754946:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.754956:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378204.754971:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787378204.755667:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.755934:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.755942:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.755949:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378204.755954:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.755962:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.755980:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378204.755983:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378204.756228:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756236:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78532f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756257:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756264:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756271:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756277:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378204.756280:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756287:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756296:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378204.756299:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378204.756303:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756309:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78532fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756384:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78532ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f3f expref: 33 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756414:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f3f expref: 32 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.756423:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:3.0:1787378204.756426:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378204.756429:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04400, rc 0) 00000100:00100000:3.0:1787378204.756537:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:10479:x1874201604569728:12345-192.168.203.22@tcp:101:cat.0 Request processed in 3302us (3585us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787378204.756547:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:3.0:1787378204.765936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378204.766327:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604569984 00000100:00100000:0.0:1787378204.766342:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604569984 00000100:00100000:0.0:1787378204.766420:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1787378204.766433:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:10479:x1874201604569984:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:0.0:1787378204.766824:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:10479:x1874201604569984:12345-192.168.203.22@tcp:35:cat.0 Request processed in 392us (904us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787378204.766834:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1787378204.796427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378204.798931:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604570240 00000100:00100000:1.0:1787378204.798952:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604570240 00000100:00100000:1.0:1787378204.799050:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:1.0:1787378204.799062:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:10480:x1874201604570240:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:1.0:1787378204.799146:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787378204.799185:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d7853303 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f3f expref: 33 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799221:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d78532d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f38 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799237:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78532a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f2a expref: 31 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799247:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:1.0:1787378204.799262:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787378204.799297:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799312:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799323:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799368:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799377:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799384:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799836:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799847:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.799855:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787378204.800551:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787378204.800564:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341062843440ns, next at 342062840473ns, rc = 0 00010000:00010000:1.0:1787378204.800648:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800661:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800671:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800679:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800700:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800706:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800769:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787378204.800796:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800803:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800810:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800816:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378204.800822:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800830:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800844:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524300) 00010000:00010000:1.0:1787378204.800848:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787378204.800853:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800860:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d785331f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.800876:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378204.800888:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800888:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.800903:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378204.800908:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.800910:0:6602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800926:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.800929:0:6602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800936:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378204.800943:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800951:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800962:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:1.0:1787378204.800965:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378204.800968:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.800973:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853311 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787378204.800986:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c89c8566 reply state 00000000e8bd8616 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378204.800997:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787378204.801005:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eeb85524300) 00010000:00010000:3.0:1787378204.801010:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787378204.801014:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.801021:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853326 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378204.801054:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378204.801056:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378204.801058:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378204.801116:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:10480:x1874201604570240:12345-192.168.203.22@tcp:36:rm.0 Request processed in 2050us (4701us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787378204.801127:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00010000:00010000:0.0:1787378204.806449:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.806473:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.806483:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.806514:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378204.806520:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.806528:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.806550:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb85524200) 00010000:00010000:0.0:1787378204.806554:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378204.806559:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.806567:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d7853318 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787378204.826061:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787378204.826074:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787378204.826131:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787378204.826154:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787378204.847174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378204.849421:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604570496 00000100:00100000:1.0:1787378204.849441:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604570496 00000100:00100000:1.0:1787378204.849539:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:1.0:1787378204.849552:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:10487:x1874201604570496:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787378204.849590:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378204.849618:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785332d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f46 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.849838:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.849855:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.849868:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.849883:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.849890:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.849896:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787378204.850626:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787378204.850883:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.850909:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.850920:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.850964:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.850972:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.850980:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.850987:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378204.850992:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.850999:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.851013:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:1.0:1787378204.851016:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378204.851022:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.851029:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853334 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787378204.851044:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c528aba4 reply state 00000000f1a949bb transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378204.851060:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787378204.851100:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785332d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 34 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.851118:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.851126:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb85524800) 00010000:00010000:1.0:1787378204.851128:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787378204.851131:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547400, rc 0) 00000100:00100000:1.0:1787378204.851243:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:10487:x1874201604570496:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1693us (4090us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787378204.851253:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00010000:00010000:2.0:1787378204.854585:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378204.855687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378204.855942:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604570624 00000100:00100000:1.0:1787378204.855956:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604570624 00000100:00100000:1.0:1787378204.856110:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:1.0:1787378204.856125:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604570624:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787378204.856149:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378204.856188:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f4d expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787378204.856235:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787378204.856261:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1787378204.856267:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378204.856278:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.856327:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378204.856343:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546000, rc 0) 00000100:00100000:1.0:1787378204.856426:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604570624:12345-192.168.203.22@tcp:101:bash.0 Request processed in 305us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378204.856436:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00010000:00010000:2.0:1787378204.856821:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.856840:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.856847:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378204.856853:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.856864:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.856882:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb85524700) 00010000:00010000:2.0:1787378204.856885:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378204.856891:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.856899:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785333b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787378204.860077:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378204.862902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378204.863858:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604570752 00000100:00100000:0.0:1787378204.863875:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604570752 00000100:00100000:0.0:1787378204.864006:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:0.0:1787378204.864019:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:10487:x1874201604570752:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378204.864044:0:8120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378204.864070:0:8120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f54 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.864115:0:8120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.864151:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378204.864156:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378204.864163:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 7 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.864222:0:8120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.864239:0:8120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 7 pid: 6589 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378204.864257:0:8120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8120:1874201626609920:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378204.864385:0:8120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb900b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787378204.876543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378204.876543:0:8120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8120:1874201626609920:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378204.876601:0:8120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 7 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378204.876628:0:8120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a800, rc 0) 00000100:00100000:2.0:1787378204.876873:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604570880 00000100:00100000:2.0:1787378204.876882:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604570880 00010000:00010000:2.0:1787378204.876939:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 8 pid: 6589 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378204.876987:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:2.0:1787378204.876998:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604570880:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378204.877018:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378204.877048:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 8 pid: 6589 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.877089:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 8 pid: 6589 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.877123:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853350 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f4d expref: 8 pid: 6589 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.877143:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378204.877149:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378204.877159:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 7 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.877172:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 7 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378204.877229:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 7 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378204.877246:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5778:1874201626610048:192.168.203.22@tcp:105: 00000100:00100000:2.0:1787378204.877348:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787378204.877930:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:10487:x1874201604570752:12345-192.168.203.22@tcp:101:bash.0 Request processed in 13911us (15037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378204.877941:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1787378204.886658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378204.887431:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604571136 00000100:00100000:0.0:1787378204.887445:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604571136 00000100:00100000:0.0:1787378204.887533:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787378204.887561:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:10487:x1874201604571136:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1787378204.888085:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:10487:x1874201604571136:12345-192.168.203.22@tcp:35:bash.0 Request processed in 525us (1440us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787378204.888094:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1787378204.889520:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5778:1874201626610048:192.168.203.22@tcp:105: 00010000:00010000:2.0:1787378204.889643:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378204.889885:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604570880:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 12887us (13352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378204.889896:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:1.0:1787378205.042270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.042488:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604571264 00000100:00100000:2.0:1787378205.042498:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604571264 00000100:00100000:2.0:1787378205.042567:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:2.0:1787378205.042578:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:10503:x1874201604571264:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378205.042601:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.042620:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785335e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f5b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787378205.042790:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787378205.042839:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.042856:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.042935:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378205.043004:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787378205.043007:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378205.043030:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.043056:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785335e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f5b expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.043074:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f5b expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.043082:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378205.043084:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378205.043100:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c7600, rc 0) 00000100:00100000:2.0:1787378205.043221:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+35:10503:x1874201604571264:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 644us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.043229:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:0.0:1787378205.048436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378205.048602:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604571520 00000100:00100000:3.0:1787378205.048612:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604571520 00000100:00100000:3.0:1787378205.048822:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:3.0:1787378205.048833:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+35:10503:x1874201604571520:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378205.048852:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378205.048885:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785336c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f62 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.048983:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853373 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.049008:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.049021:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378205.049033:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787378205.049152:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785336c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f62 expref: 38 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.049182:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853373 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f62 expref: 37 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.049190:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb85524800) 00010000:00010000:3.0:1787378205.049372:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378205.049377:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05800, rc 0) 00000100:00100000:3.0:1787378205.049445:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:10503:x1874201604571520:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 613us (1018us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787378205.049452:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1787378205.055564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.055610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378205.055759:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604571776 00000100:00100000:1.0:1787378205.055769:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604571776 00000100:00100000:1.0:1787378205.055836:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:1.0:1787378205.055846:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:10503:x1874201604571776:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378205.056090:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378205.056111:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853381 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f69 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.056225:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853388 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.056240:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853388 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.056250:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853388 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378205.056275:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787378205.056391:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853381 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f69 expref: 40 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.056410:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853388 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f69 expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.056419:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb85524800) 00010000:00010000:1.0:1787378205.056421:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787378205.056425:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546e00, rc 0) 00000100:00100000:1.0:1787378205.056489:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+39:10503:x1874201604571776:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 644us (934us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787378205.056497:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:3.0:1787378205.059201:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604571904 00000100:00100000:3.0:1787378205.059226:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604571904 00000100:00100000:3.0:1787378205.059327:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1787378205.059337:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+39:2353:x1874201604571904:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378205.059353:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378205.059377:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853373 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f62 expref: 39 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.059393:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb85524800) 00010000:00010000:3.0:1787378205.059398:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378205.059469:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+38:2353:x1874201604571904:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 125us (3849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378205.059478:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787378205.063364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378205.063452:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604572032 00000100:00100000:1.0:1787378205.063525:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604572032 00000100:00100000:1.0:1787378205.063580:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1787378205.063590:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604572032:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:1.0:1787378205.063634:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.063858:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 6 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.063936:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378205.063941:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787378205.063946:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.064007:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 6 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.064021:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 6 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378205.064037:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6589:1874201626610176:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378205.064157:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207600 going to sleep for 11 seconds 00000100:00100000:3.0:1787378205.067031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.067087:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604572160 00000100:00100000:0.0:1787378205.067095:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604572160 00002000:00100000:0.0:1787378205.067137:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9eeb867dc700 x1874201604572160/t0(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:276/0 lens 504/0 e 0 to 0 dl 1787378216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378205.067148:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb867dc700 with x1874201604572160 ext(0->8) 00010000:00010000:0.0:1787378205.067157:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 7 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.067172:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 7 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378205.067179:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9eeb867dc700 00000100:00100000:0.0:1787378205.067200:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787378205.067219:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604572160:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:1.0:1787378205.068411:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6589:1874201626610176:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378205.068438:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.068906:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2354:x1874201604572160:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 1685us (1878us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787378205.068916:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00002000:00100000:0.0:1787378205.068925:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9eeb867dc700 x1874201604572160/t4294967302(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:276/0 lens 504/448 e 0 to 0 dl 1787378216 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378205.068952:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb867dc700 with x1874201604572160 ext(0->8) 00010000:00010000:0.0:1787378205.068960:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 9 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.068973:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 9 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378205.068980:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9eeb867dc700 00000100:00100000:3.0:1787378205.071837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.072102:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604572288 00000100:00100000:2.0:1787378205.072112:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604572288 00010000:00010000:2.0:1787378205.072151:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 9 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378205.072200:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1787378205.072218:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2353:x1874201604572288:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378205.072232:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787378205.072251:0:8358:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787378205.072254:0:8358:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787378204 00002000:00010000:2.0:1787378205.072256:0:8358:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787378205 00002000:00010000:2.0:1787378205.072258:0:8358:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787378204 00010000:00010000:2.0:1787378205.072264:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 9 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.072278:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 9 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.072301:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d7853357 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f54 expref: 9 pid: 8120 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.072334:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787378205.072338:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787378205.072345:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.072355:0:8358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.072382:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378205.072428:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604572288:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 212us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.072435:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00010000:00010000:0.0:1787378205.072750:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.072761:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.072787:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.072796:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.072804:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.072811:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378205.072815:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.072833:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.072846:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.072854:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853396 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.073089:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604572032:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 9499us (9732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.073098:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:2.0:1787378205.076602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.077247:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604572544 00000100:00100000:0.0:1787378205.077257:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604572544 00000100:00100000:0.0:1787378205.077354:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1787378205.077365:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+38:10503:x1874201604572544:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:0.0:1787378205.077429:0:5793:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853388 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f69 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787378205.077906:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787378205.077958:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787378205.078312:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787378205.078367:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.078383:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.078405:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.078439:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.078453:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 42 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.078843:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5793:1874201626610304:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378205.078930:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb811ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378205.083325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.083430:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604572672 00000100:00100000:2.0:1787378205.083440:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604572672 00000100:00100000:3.0:1787378205.083486:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5793:1874201626610304:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378205.083512:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.083566:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 43 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378205.083604:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:2.0:1787378205.083614:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+43:2354:x1874201604572672:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378205.083629:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378205.083636:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 43 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.083787:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 43 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.083826:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f46 expref: 43 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.083842:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb85524800) 00010000:00010000:2.0:1787378205.083848:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.083858:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.083865:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.084078:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.084086:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787378205.084228:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787378205.084429:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787378205.084665:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867ddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626610432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787378205.084742:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378205.084778:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb85693f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378205.084921:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626610432 00000100:00100000:1.0:1787378205.084928:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626610432 00000100:00100000:1.0:1787378205.084986:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787378205.085006:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5793:x1874201626610432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787378205.085082:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5793:x1874201626610432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378205.085089:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787378205.085439:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787378205.085481:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867ddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626610432:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1787378205.086259:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378205.086317:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+44:2354:x1874201604572672:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 2700us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.086326:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000001:00080000:2.0:1787378205.088152:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787378205.088332:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626610560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787378205.088396:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378205.088490:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378205.088633:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626610560 00000100:00100000:1.0:1787378205.088641:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626610560 00000100:00100000:0.0:1787378205.089387:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378205.089397:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5793:x1874201626610560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787378205.089636:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5793:x1874201626610560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 240us (1239us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787378205.089645:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787378205.089746:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626610560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787378205.089811:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787378205.089856:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.089880:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.089889:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.089895:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378205.089900:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.089907:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.089923:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb85524800) 00010000:00010000:3.0:1787378205.089926:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787378205.089931:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.089945:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785339d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787378205.090145:0:5793:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787378205.090273:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787378205.090286:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341352565912ns, next at 342352563561ns, rc = 0 00000001:00080000:3.0:1787378205.090293:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787378205.090327:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb85524800) 00010000:00010000:3.0:1787378205.090330:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787378205.090338:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546e00/0xdd3c5462d7853388 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f69 expref: 46 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378205.090457:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:10503:x1874201604572544:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 13094us (13864us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787378205.090466:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000020:00080000:3.0:1787378205.090470:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787378205.093253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378205.093476:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604572800 00000100:00100000:3.0:1787378205.093486:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604572800 00000100:00100000:3.0:1787378205.093546:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:3.0:1787378205.093556:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:10503:x1874201604572800:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378205.093580:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378205.093603:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78533a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f70 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.093669:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78533a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f70 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.093702:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78533a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f70 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.093744:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378205.093748:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787378205.093751:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05800, rc 0) 00000100:00100000:3.0:1787378205.093805:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+46:10503:x1874201604572800:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 250us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378205.093812:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:1.0:1787378205.096860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.097229:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604573056 00000100:00100000:2.0:1787378205.097239:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604573056 00000100:00100000:2.0:1787378205.097293:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:2.0:1787378205.097302:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+46:10503:x1874201604573056:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787378205.097536:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+47:10503:x1874201604573056:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 234us (683us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787378205.097555:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:3.0:1787378205.161098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.161313:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604573184 00000100:00100000:0.0:1787378205.161323:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604573184 00000100:00100000:0.0:1787378205.161382:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:0.0:1787378205.161392:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+47:10513:x1874201604573184:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1787378205.161474:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161490:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161516:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161531:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161537:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161543:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161633:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161641:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161660:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378205.161700:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161711:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161754:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161761:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161777:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378205.161781:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161789:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161800:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:0.0:1787378205.161803:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378205.161807:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161813:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78533ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161826:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161832:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161837:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161841:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378205.161844:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161849:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.161864:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378205.162072:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378205.162076:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.162082:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.162098:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.162104:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.162110:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.162115:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378205.162117:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.162122:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.162130:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:0.0:1787378205.162132:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378205.162135:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.162140:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.162229:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+47:10513:x1874201604573184:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 836us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.162238:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:1.0:1787378205.216576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378205.216843:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604573440 00000100:00100000:3.0:1787378205.216853:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604573440 00000100:00100000:3.0:1787378205.216923:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:3.0:1787378205.216933:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+47:10516:x1874201604573440:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378205.216954:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378205.216976:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78533c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f77 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217083:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217099:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217110:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217136:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217145:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217152:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217302:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217312:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217319:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378205.217329:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787378205.217431:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217439:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217445:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217451:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378205.217455:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217484:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217496:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378205.217499:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378205.217504:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217509:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78533c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217525:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217530:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217535:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217540:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378205.217543:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217549:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217556:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb97cb4700) 00010000:00010000:3.0:1787378205.217559:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378205.217561:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217575:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78533ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217615:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78533c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 50 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217628:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 49 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.217635:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378205.217637:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378205.217640:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05a00, rc 0) 00000100:00100000:3.0:1787378205.218144:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+49:10516:x1874201604573440:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1210us (1574us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787378205.218153:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:2.0:1787378205.226747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.226840:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604573568 00000100:00100000:0.0:1787378205.226850:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604573568 00000100:00100000:0.0:1787378205.226917:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:0.0:1787378205.226928:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+49:10516:x1874201604573568:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787378205.227003:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227019:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227031:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227056:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227063:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227070:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227075:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378205.227080:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227087:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227115:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:0.0:1787378205.227118:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378205.227122:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.227127:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.227201:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+49:10516:x1874201604573568:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 274us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.227217:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:1.0:1787378205.231769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.231898:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604573824 00000100:00100000:2.0:1787378205.231907:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604573824 00000100:00100000:2.0:1787378205.231963:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:2.0:1787378205.231973:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+49:10516:x1874201604573824:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787378205.232337:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+50:10516:x1874201604573824:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 364us (617us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787378205.232345:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:2.0:1787378205.307492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.307538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.307573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.307612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.307705:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604573952 00000100:00100000:0.0:1787378205.307715:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604573952 00000100:00100000:0.0:1787378205.307793:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:0.0:1787378205.307803:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604573952:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378205.307878:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604573952:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 65us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.307887:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:3.0:1787378205.308080:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604574208 00000100:00100000:3.0:1787378205.308084:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604574208 00000100:00100000:3.0:1787378205.308128:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604574080 00000100:00100000:3.0:1787378205.308132:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604574080 00000100:00100000:3.0:1787378205.308148:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:3.0:1787378205.308154:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2356:x1874201604574208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378205.308183:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2356:x1874201604574208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378205.308189:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:3.0:1787378205.308200:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:3.0:1787378205.308216:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2356:x1874201604574080:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378205.308252:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2356:x1874201604574080:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 37us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378205.308258:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00080000:0.0:1787378205.308323:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378205.308487:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604574336 00000100:00100000:1.0:1787378205.308492:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604574336 00000100:00100000:1.0:1787378205.308537:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:1.0:1787378205.308543:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604574336:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378205.308568:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2356:x1874201604574336:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378205.308574:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00080000:0.0:1787378205.308794:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378205.312794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.313003:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604574592 00000100:00100000:0.0:1787378205.313013:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604574592 00000100:00100000:0.0:1787378205.313067:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:0.0:1787378205.313077:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+50:10526:x1874201604574592:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378205.313103:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378205.313107:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787378205.313133:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f5b expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.313173:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:0.0:1787378205.313178:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378205.313191:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f7e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.313294:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.313309:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 50 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.313319:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.313352:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 50 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.313365:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 50 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.313377:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626610688:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378205.314412:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb811ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378205.318005:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626610688:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378205.318035:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378205.319920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378205.320456:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604574720 00000100:00100000:3.0:1787378205.320475:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604574720 00010000:00010000:3.0:1787378205.320513:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 51 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378205.320555:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1787378205.320564:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+51:2354:x1874201604574720:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378205.320579:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378205.320586:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 51 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.320599:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 51 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.320621:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d78533d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f77 expref: 51 pid: 5792 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.320638:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378205.320643:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.320653:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.320660:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.321038:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378205.321104:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+50:2354:x1874201604574720:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 539us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378205.321112:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00010000:00010000:0.0:1787378205.322998:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.323027:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378205.323050:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787378205.323239:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78533ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.323260:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.323270:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:0.0:1787378205.323274:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787378205.323277:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128aa00, rc 0) 00000100:00100000:0.0:1787378205.323334:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+50:10526:x1874201604574592:12345-192.168.203.22@tcp:101:bash.0 Request processed in 10258us (10549us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787378205.323345:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:1.0:1787378205.327639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.327861:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604574976 00000100:00100000:2.0:1787378205.327881:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604574976 00000100:00100000:2.0:1787378205.327943:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:2.0:1787378205.327954:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+50:10526:x1874201604574976:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1787378205.328264:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.328283:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.328294:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378205.328345:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787378205.328376:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c36a7fe8 reply state 00000000ed0e01e8 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378205.328385:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378205.328478:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:10526:x1874201604574976:12345-192.168.203.22@tcp:36:bash.0 Request processed in 525us (849us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787378205.328486:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00000020:00080000:2.0:1787378205.328491:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787378205.334601:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.334620:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.334628:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.334634:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378205.334640:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.334675:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.334693:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:0.0:1787378205.334696:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378205.334702:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.334708:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d78533ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378205.337473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.337563:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604575104 00000100:00100000:0.0:1787378205.337572:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604575104 00000100:00100000:0.0:1787378205.337636:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:0.0:1787378205.337646:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:10526:x1874201604575104:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378205.337681:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378205.337702:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.337821:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.337837:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.337846:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.337891:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.337911:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 53 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.337925:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626610816:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378205.338010:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb900b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378205.341399:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626610816:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378205.341430:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378205.345410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378205.345945:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604575232 00000100:00100000:3.0:1787378205.345956:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604575232 00010000:00010000:3.0:1787378205.346008:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 54 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378205.346048:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1787378205.346058:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:2354:x1874201604575232:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378205.346072:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378205.346079:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 54 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.346092:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 54 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.346113:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78533f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f7e expref: 54 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.346128:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378205.346133:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.346142:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.346177:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.346217:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378205.346279:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:2354:x1874201604575232:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 222us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378205.346287:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00010000:00010000:0.0:1787378205.346563:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.346574:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378205.346617:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787378205.346622:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787378205.346642:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.346683:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 53 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.346698:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 52 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.346706:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:0.0:1787378205.346716:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378205.346767:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:0.0:1787378205.346806:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:10526:x1874201604575104:12345-192.168.203.22@tcp:101:bash.0 Request processed in 9161us (9347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.346813:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:1.0:1787378205.351578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.351847:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604575488 00000100:00100000:2.0:1787378205.351857:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604575488 00000100:00100000:2.0:1787378205.352023:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1787378205.352033:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:10526:x1874201604575488:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1787378205.352499:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:10526:x1874201604575488:12345-192.168.203.22@tcp:35:bash.0 Request processed in 467us (929us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787378205.352508:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1787378205.413004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.413297:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604575616 00000100:00100000:2.0:1787378205.413306:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604575616 00000100:00100000:2.0:1787378205.413592:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:2.0:1787378205.413604:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:10532:x1874201604575616:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378205.413630:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.413650:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853414 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f8c expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.413713:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785341b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.413760:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785341b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.413789:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785341b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378205.414229:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787378205.414234:0:9982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378205.414259:0:9982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785341b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.414288:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7600/0xdd3c5462d7853414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f8c expref: 55 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.414306:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785341b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f8c expref: 54 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.414314:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378205.414317:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378205.414320:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebc21c6400, rc 0) 00000100:00100000:2.0:1787378205.414469:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:10532:x1874201604575616:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 858us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.414476:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:1.0:1787378205.417116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.417237:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604575744 00000100:00100000:2.0:1787378205.417247:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604575744 00000100:00100000:2.0:1787378205.417303:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:2.0:1787378205.417313:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:10532:x1874201604575744:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378205.417332:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.417352:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7853422 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f93 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417443:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417456:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417467:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417482:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417490:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417497:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417592:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d7853437 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417600:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d7853437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417607:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d7853437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378205.417640:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787378205.417644:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378205.417660:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d7853437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417679:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d7853437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417687:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417692:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417697:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417703:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.417706:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417714:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417870:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378205.417944:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378205.417950:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417957:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853429 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417971:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417977:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417989:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.417994:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.417997:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.418004:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.418012:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeba261e500) 00010000:00010000:2.0:1787378205.418014:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378205.418017:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.418022:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.418057:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7200/0xdd3c5462d7853422 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f93 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.418070:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d7853437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f93 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.418076:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378205.418078:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378205.418081:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1e00, rc 0) 00000100:00100000:2.0:1787378205.418190:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:10532:x1874201604575744:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 876us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.418217:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:1.0:1787378205.424915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.425030:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604576128 00000100:00100000:2.0:1787378205.425040:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604576128 00000100:00100000:2.0:1787378205.425109:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1787378205.425119:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:2354:x1874201604576128:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378205.425137:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378205.425164:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d7853437 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f93 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.425186:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378205.425190:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378205.425255:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:2354:x1874201604576128:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 137us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.425263:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787378205.425771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.425837:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604576000 00000100:00100000:2.0:1787378205.425843:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604576000 00000100:00100000:2.0:1787378205.425882:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:2.0:1787378205.425889:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:10532:x1874201604576000:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378205.425905:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.425923:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785343e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6f9a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.426033:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.426048:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.426070:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.426103:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.426116:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 55 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378205.426129:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626610944:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378205.426195:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378205.437330:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626610944:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378205.437361:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.438051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378205.438488:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604576256 00000100:00100000:3.0:1787378205.438499:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604576256 00010000:00010000:3.0:1787378205.438604:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 56 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378205.438679:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:3.0:1787378205.438690:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:2354:x1874201604576256:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378205.438704:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378205.438711:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 56 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.438744:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 56 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.438764:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785340d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f85 expref: 56 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.438781:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378205.438786:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.438808:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.438815:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378205.438848:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378205.438916:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:2354:x1874201604576256:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 227us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378205.438924:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00010000:00010000:0.0:1787378205.439076:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.439085:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378205.439104:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787378205.439800:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785343e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.439820:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.439829:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:0.0:1787378205.439832:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787378205.439835:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1400, rc 0) 00000100:00100000:0.0:1787378205.439885:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:10532:x1874201604576000:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 13995us (14116us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787378205.439893:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:0.0:1787378205.447474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378205.447569:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604576512 00000100:00100000:1.0:1787378205.447580:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604576512 00000100:00100000:1.0:1787378205.447653:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1787378205.447665:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:10532:x1874201604576512:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:1.0:1787378205.447680:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378205.447708:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78533a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f70 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378205.447752:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:1.0:1787378205.447770:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378205.447822:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:10532:x1874201604576512:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 159us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378205.447831:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1787378205.450447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.450608:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604576640 00000100:00100000:0.0:1787378205.450618:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604576640 00000100:00100000:0.0:1787378205.450680:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:0.0:1787378205.450703:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:10532:x1874201604576640:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:0.0:1787378205.450857:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.451084:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.451095:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787378205.451843:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787378205.452191:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:10532:x1874201604576640:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 1486us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.452212:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:0.0:1787378205.454420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.454507:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604576768 00000100:00100000:2.0:1787378205.454589:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604576768 00000100:00100000:2.0:1787378205.454650:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:2.0:1787378205.454660:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:10532:x1874201604576768:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378205.454681:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.454702:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fa1 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.454795:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.454822:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa1 expref: 55 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.454842:0:9982:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.454855:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa1 expref: 55 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.454878:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378205.455058:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378205.455063:0:9982:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa1 expref: 55 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.455072:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1e00, rc 0) 00000100:00100000:2.0:1787378205.455129:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:10532:x1874201604576768:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 470us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.455220:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 111 00010000:00010000:0.0:1787378205.658077:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787378205.753777:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1787378205.753793:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:1.0:1787378205.850004:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787378205.850014:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787378205.850089:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787378205.850096:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787378205.850237:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53ed880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626611072:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787378205.850831:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787378205.867063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.867225:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604576896 00000100:00100000:2.0:1787378205.867234:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604576896 00000100:00100000:2.0:1787378205.867297:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:2.0:1787378205.867308:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:10533:x1874201604576896:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787378205.867341:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787378205.867457:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:10533:x1874201604576896:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 150us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.867465:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:1.0:1787378205.869476:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53ed880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626611072:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787378205.874402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.875678:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604577024 00000100:00100000:2.0:1787378205.875691:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604577024 00000100:00100000:2.0:1787378205.875789:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:2.0:1787378205.875800:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:10533:x1874201604577024:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787378205.875872:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.875890:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876129:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876192:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876210:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876217:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876241:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876249:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876256:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378205.876294:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787378205.876311:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378205.876325:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876337:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876344:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876350:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876356:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.876360:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876368:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876380:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:2.0:1787378205.876383:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378205.876388:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876394:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853461 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876406:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876412:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876426:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876432:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.876434:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876440:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876448:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9eeba261ee00) 00010000:00010000:2.0:1787378205.876450:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378205.876453:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876459:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853468 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876473:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876479:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876484:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876489:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.876491:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876505:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876513:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378205.876515:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378205.876518:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.876523:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785346f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378205.876747:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:10533:x1874201604577024:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 919us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.876758:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:3.0:1787378205.895634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.895773:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604577280 00000100:00100000:2.0:1787378205.895782:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604577280 00000100:00100000:2.0:1787378205.895837:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:2.0:1787378205.895846:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:10533:x1874201604577280:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378205.895865:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.895884:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853476 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fa8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.895989:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896003:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896013:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378205.896036:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787378205.896123:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896131:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896138:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896143:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.896147:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896155:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896166:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378205.896169:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787378205.896173:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896179:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785347d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896226:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853476 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa8 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896236:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:2.0:1787378205.896242:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378205.896251:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853476 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa8 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.896261:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1800, rc 0) 00000100:00100000:2.0:1787378205.896322:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:10533:x1874201604577280:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 477us (696us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787378205.896330:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:0.0:1787378205.904257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.904424:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604577408 00000100:00100000:2.0:1787378205.904433:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604577408 00000100:00100000:2.0:1787378205.904477:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:2.0:1787378205.904485:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:10533:x1874201604577408:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787378205.904530:0:9982:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787378205.904650:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:10533:x1874201604577408:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 165us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.904658:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:1.0:1787378205.913467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.914023:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604577664 00000100:00100000:2.0:1787378205.914035:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604577664 00000100:00100000:2.0:1787378205.914099:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:2.0:1787378205.914108:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:10533:x1874201604577664:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378205.914130:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.914133:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787378205.914159:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c6400/0xdd3c5462d785341b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f8c expref: 56 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.914180:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378205.914185:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378205.914209:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785348b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6faf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787378205.914642:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787378205.914919:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.914932:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.914940:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.914990:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785348b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6faf expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.915004:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6faf expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.915012:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261ee00) 00010000:00010000:2.0:1787378205.915015:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378205.915018:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0200, rc 0) 00000100:00100000:2.0:1787378205.915091:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:10533:x1874201604577664:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 984us (2164us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787378205.915099:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:3.0:1787378205.921410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.921505:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604577920 00000100:00100000:2.0:1787378205.921520:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604577920 00000100:00100000:2.0:1787378205.921583:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:2.0:1787378205.921593:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:10533:x1874201604577920:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787378205.921681:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378205.921713:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6faf expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.921894:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261ee00) 00010000:00010000:2.0:1787378205.921905:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378205.921937:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.921951:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.921961:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922103:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922114:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922123:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922191:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922208:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922215:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922222:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.922231:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922239:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922248:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378205.922251:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378205.922254:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922261:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922270:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922365:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922376:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922384:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.922387:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922397:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922407:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x191f80a3 (ffff9eeba261e500) 00010000:00010000:2.0:1787378205.922411:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378205.922426:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.922437:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x191f80a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378205.924312:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:10533:x1874201604577920:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 2710us (2900us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787378205.924326:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:3.0:1787378205.935820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.935962:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604578048 00000100:00100000:2.0:1787378205.935972:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604578048 00000100:00100000:2.0:1787378205.936029:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:2.0:1787378205.936039:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:10533:x1874201604578048:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378205.936059:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.936084:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fb6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.936118:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.936130:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.936142:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.936255:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.936275:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.936291:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:2.0:1787378205.936294:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787378205.936298:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1800, rc 0) 00000100:00100000:2.0:1787378205.936362:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:10533:x1874201604578048:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 324us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.936369:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:1.0:1787378205.942990:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.943063:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604578304 00000100:00100000:0.0:1787378205.943073:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604578304 00000100:00100000:0.0:1787378205.943134:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:0.0:1787378205.943144:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:10533:x1874201604578304:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787378205.943241:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.943258:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.943270:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787378205.943536:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1787378205.943546:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342205826081ns, next at 343205823606ns, rc = 0 00000004:00010000:0.0:1787378205.943641:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e602878 reply state 000000001709c7d1 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378205.943652:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787378205.943793:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:10533:x1874201604578304:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 649us (811us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787378205.943801:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00010000:00010000:2.0:1787378205.945860:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.945876:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.945884:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.945896:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378205.945900:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.945909:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.945939:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:2.0:1787378205.945943:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787378205.945949:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.945956:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78534bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378205.948480:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.948676:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604578432 00000100:00100000:0.0:1787378205.948687:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604578432 00000100:00100000:0.0:1787378205.948914:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:0.0:1787378205.948943:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:10533:x1874201604578432:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378205.948968:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378205.948989:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fbd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.949045:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.949060:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.949079:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:0.0:1787378205.949083:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787378205.949087:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a800, rc 0) 00000100:00100000:0.0:1787378205.949160:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:10533:x1874201604578432:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 236us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.949166:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:3.0:1787378205.954585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.955780:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604578560 00000100:00100000:0.0:1787378205.955794:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604578560 00000100:00100000:0.0:1787378205.955869:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1787378205.955880:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604578560:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787378205.956383:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2354:x1874201604578560:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 502us (1806us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787378205.956393:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:3.0:1787378205.965837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.965955:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604578816 00000100:00100000:2.0:1787378205.965964:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604578816 00000100:00100000:2.0:1787378205.966033:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:2.0:1787378205.966043:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:10533:x1874201604578816:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787378205.966647:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:10533:x1874201604578816:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 603us (816us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787378205.966657:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:1.0:1787378205.974628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.974789:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604579072 00000100:00100000:0.0:1787378205.974799:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604579072 00000100:00100000:0.0:1787378205.974859:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:0.0:1787378205.974870:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:10533:x1874201604579072:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787378205.975573:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:10533:x1874201604579072:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 702us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.975582:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:3.0:1787378205.981696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378205.981928:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604579200 00000100:00100000:2.0:1787378205.981937:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604579200 00000100:00100000:2.0:1787378205.981985:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:2.0:1787378205.982006:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:10533:x1874201604579200:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378205.982027:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378205.982046:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fc4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.982324:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78534d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.982340:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78534d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.982351:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78534d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378205.982391:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378205.982410:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78534d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.982471:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78534ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fc4 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.982491:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78534d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fc4 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378205.982500:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:2.0:1787378205.982503:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787378205.982507:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0200, rc 0) 00000100:00100000:2.0:1787378205.982576:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:10533:x1874201604579200:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 570us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378205.982584:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:3.0:1787378205.989337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378205.989491:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604579328 00000100:00100000:0.0:1787378205.989503:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604579328 00000100:00100000:0.0:1787378205.989565:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:0.0:1787378205.989574:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2353:x1874201604579328:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378205.989592:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378205.989612:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fcb expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378205.989639:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a893a1d, blocks: 0x1 00010000:00010000:0.0:1787378205.989671:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1787378205.989675:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378205.989685:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 10 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.989702:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 10 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378205.989715:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a000, rc 0) 00000100:00100000:0.0:1787378205.989809:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:2353:x1874201604579328:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 236us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378205.989817:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1787378206.010142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378206.011793:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604579584 00000100:00100000:0.0:1787378206.011807:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604579584 00000100:00100000:0.0:1787378206.011876:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:0.0:1787378206.011886:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:10533:x1874201604579584:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787378206.011994:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:10533:x1874201604579584:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 108us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378206.012002:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:3.0:1787378206.018844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378206.018955:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604579712 00000100:00100000:2.0:1787378206.018965:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604579712 00000100:00100000:2.0:1787378206.019024:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:2.0:1787378206.019035:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:10533:x1874201604579712:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378206.019053:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378206.019072:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fd2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.019126:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 11 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.019135:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378206.019139:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378206.019145:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.019195:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 11 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.019219:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 11 pid: 6589 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378206.019233:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626611200:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378206.019316:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378206.022406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378206.022747:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604579840 00000100:00100000:0.0:1787378206.022757:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604579840 00010000:00010000:0.0:1787378206.022802:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 12 pid: 6589 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.022845:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1787378206.022855:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:2354:x1874201604579840:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378206.022886:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378206.022912:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 12 pid: 6589 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.022928:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 12 pid: 6589 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.022953:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378206.022958:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378206.022968:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.022979:0:8358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.023032:0:8358:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.023048:0:8358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8358:1874201626611328:192.168.203.22@tcp:105: 00010000:00010000:2.0:1787378206.023325:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000835f72e9/0xdd3c5462d78534d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fcb expref: 12 pid: 6589 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378206.023342:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626611200:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378206.023370:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.023381:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1c00, rc 0) 00000100:00100000:0.0:1787378206.023504:0:8358:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787378206.027576:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:10533:x1874201604579712:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 8529us (8729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378206.027591:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1787378206.031682:0:8358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8358:1874201626611328:192.168.203.22@tcp:105: 00010000:00010000:0.0:1787378206.031708:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378206.031786:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:2354:x1874201604579840:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 8931us (9388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378206.031796:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1787378206.033435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378206.041274:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604579968 00000100:00100000:3.0:1787378206.041292:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604579968 00002000:00100000:3.0:1787378206.041362:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9eebb53edc00 x1874201604579968/t0(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:277/0 lens 504/0 e 0 to 0 dl 1787378217 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787378206.041374:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebb53edc00 with x1874201604579968 ext(0->12) 00002000:00010000:3.0:1787378206.041380:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eebb53edc00 00000100:00100000:3.0:1787378206.041515:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1787378206.041526:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:2354:x1874201604579968:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787378206.042023:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:2354:x1874201604579968:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 495us (8592us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787378206.042032:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00002000:00100000:3.0:1787378206.042040:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9eebb53edc00 x1874201604579968/t4294967308(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:277/0 lens 504/448 e 0 to 0 dl 1787378217 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787378206.042049:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebb53edc00 with x1874201604579968 ext(0->12) 00002000:00010000:3.0:1787378206.042053:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eebb53edc00 00000100:00100000:1.0:1787378206.047087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378206.047287:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604580096 00000100:00100000:2.0:1787378206.047297:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604580096 00000100:00100000:2.0:1787378206.047348:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:2.0:1787378206.047358:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:10533:x1874201604580096:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787378206.084688:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787378206.084700:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787378206.084770:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787378206.084782:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eeb905ff3c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787378206.084786:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eebad36ba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb905ff480 00000020:00080000:1.0:1787378206.084789:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eebad36bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eebbac70c00 00000001:00080000:1.0:1787378206.084802:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:1.0:1787378206.084840:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eeb85693f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787378206.084843:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eebbc347900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb85693480 00000020:00080000:1.0:1787378206.084846:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eebbc347300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eebbac73c00 00000004:00080000:1.0:1787378206.084872:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787378206.084903:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787378206.085085:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787378206.085208:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626611456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787378206.085277:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378206.085358:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626611456 00000100:00100000:1.0:1787378206.085365:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626611456 00000100:00100000:1.0:1787378206.085409:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787378206.085418:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626611456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787378206.085449:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787378206.085498:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a893a1c, atime: 0x6a893a1d, ctime: 0x6a893a1c, blocks: 0xb 00010000:00010000:1.0:1787378206.085506:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.085526:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1787378206.085530:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378206.085538:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.085554:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.085564:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.085580:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.085597:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787378206.086107:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626611456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 688us (828us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787378206.086115:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787378206.086141:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378206.086148:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.086156:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378206.086161:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.086170:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.086187:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.086194:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f5f697/0xdd3c5462d78534e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.086225:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378206.086232:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378206.086234:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378206.086263:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787378206.086269:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1787378206.086286:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eebad230380, transno 4294967301 00000004:00080000:1.0:1787378206.086295:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1787378206.086309:0:3311:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9eebb53efb80 x1874201626611456/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787378222 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787378206.086319:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eebb53efb80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787378206.086323:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626611456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787378206.086658:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10533:x1874201604580096:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 39297us (39577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378206.086668:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:1.0:1787378206.087173:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626611584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787378206.087221:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378206.087311:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626611584 00000100:00100000:0.0:1787378206.087317:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626611584 00000100:00100000:0.0:1787378206.087370:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787378206.087378:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874201626611584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787378206.087400:0:8120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787378206.087422:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.087440:0:8120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.087448:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787378206.087458:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787378206.087462:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.087504:0:8120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.087517:0:8120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 11 pid: 6586 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.087530:0:8120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8120:1874201626611840:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378206.087574:0:8120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c240 going to sleep for 11 seconds 00000100:00080000:1.0:1787378206.089286:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787378206.089716:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787378206.089756:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626611712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787378206.089817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378206.092543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378206.093079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378206.093106:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604580352 00000100:00100000:1.0:1787378206.093115:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604580352 00010000:00010000:1.0:1787378206.093152:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 12 pid: 6586 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378206.093768:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:1.0:1787378206.093780:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:2354:x1874201604580352:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378206.093798:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378206.093806:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 12 pid: 6586 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.093820:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 12 pid: 6586 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.093870:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787378206.093875:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787378206.093881:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.093892:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.093916:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378206.093972:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:2354:x1874201604580352:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 194us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378206.093981:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00010000:00010000:1.0:1787378206.094872:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc8d363/0xdd3c5462d78532a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f31 expref: 11 pid: 6586 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378206.094893:0:8120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8120:1874201626611840:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378206.094912:0:8120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.094922:0:8120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.094929:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.094953:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.094962:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.094994:0:8120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787378206.095797:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1874201626611584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8416us (8572us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787378206.095807:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787378206.095910:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626611712 00000100:00100000:0.0:1787378206.095917:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626611712 00000100:00100000:0.0:1787378206.095954:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604580224 00000100:00100000:0.0:1787378206.095964:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604580224 00000100:00100000:0.0:1787378206.095996:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787378206.096005:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1874201626611712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787378206.096124:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787378206.096128:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787378206 00002000:00010000:0.0:1787378206.096130:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787378206.096133:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787378205 -> 1787378206 00002000:00010000:0.0:1787378206.096135:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787378206.096487:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1874201626611712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 482us (6668us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787378206.096495:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787378206.096512:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1787378206.096520:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:2353:x1874201604580224:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787378206.096583:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eeb901f8380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787378206.096590:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626611712:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1787378206.097466:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378206.097476:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.097489:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378206.097494:0:6602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.097505:0:6602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.097540:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.097546:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020ad3563/0xdd3c5462d78534ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.097567:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378206.097570:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378206.097571:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787378206.099374:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eeb901f9c00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787378206.099389:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626611584:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1787378206.126080:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1787378206.126099:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1787378206.126116:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1787378206.126271:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604580224:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 29746us (33731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378206.126283:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:1.0:1787378206.128828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378206.128918:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604580608 00000100:00100000:0.0:1787378206.128928:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604580608 00000100:00100000:0.0:1787378206.129081:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:0.0:1787378206.129092:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10533:x1874201604580608:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787378206.129146:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378206.129183:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78534d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fc4 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.129212:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:0.0:1787378206.129217:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378206.129249:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.129262:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.129272:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378206.129524:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002999efa6 reply state 000000004345c728 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.129534:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787378206.129630:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:10533:x1874201604580608:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 539us (810us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787378206.129638:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:1.0:1787378206.132436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:3.0:1787378206.132681:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.132694:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.132702:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.132709:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378206.132714:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.132764:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.132780:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:3.0:1787378206.132784:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378206.132788:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.132794:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78534f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378206.132828:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604580736 00000100:00100000:3.0:1787378206.132836:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604580736 00000100:00100000:3.0:1787378206.132877:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1787378206.132886:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604580736:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787378206.133294:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787378206.133299:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787378206 -> 1787378205 00002000:00010000:3.0:1787378206.133301:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787378205 00002000:00010000:3.0:1787378206.133304:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787378206 -> 1787378205 00002000:00010000:3.0:1787378206.133306:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787378206.133372:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604580736:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 485us (943us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787378206.133379:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1787378206.135608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378206.135693:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604580992 00000100:00100000:0.0:1787378206.135702:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604580992 00000100:00100000:0.0:1787378206.135788:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:0.0:1787378206.135799:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:10533:x1874201604580992:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787378206.135864:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.135888:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.135897:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.135933:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.135948:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 15 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.135962:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae373480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626611968:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378206.136066:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378206.141932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378206.142514:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604581120 00000100:00100000:2.0:1787378206.142529:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604581120 00010000:00010000:2.0:1787378206.142579:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 16 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378206.142618:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:2.0:1787378206.142628:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:2353:x1874201604581120:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378206.142643:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378206.142650:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 16 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.142664:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 16 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.142688:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:2.0:1787378206.142694:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.142704:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.142713:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.142759:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378206.142828:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:2353:x1874201604581120:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 201us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378206.142837:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00010000:00010000:0.0:1787378206.143240:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78534b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fb6 expref: 15 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.143474:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae373480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626611968:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378206.143498:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143508:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143514:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143543:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143551:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143558:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143564:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378206.143568:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143575:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143585:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:0.0:1787378206.143597:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787378206.143601:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.143607:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78534fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.143663:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10533:x1874201604580992:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 7865us (8064us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787378206.143672:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:1.0:1787378206.147839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378206.149789:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604581248 00000100:00100000:2.0:1787378206.149802:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604581248 00000100:00100000:2.0:1787378206.149878:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1787378206.149888:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604581248:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787378206.149933:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.149952:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.149960:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378206.149964:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787378206.149968:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.150001:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.150015:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 7 pid: 6588 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378206.150030:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626612096:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378206.150126:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378206.153757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378206.154008:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604581376 00000100:00100000:0.0:1787378206.154017:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604581376 00010000:00010000:0.0:1787378206.154057:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 8 pid: 6588 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.154097:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:0.0:1787378206.154112:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604581376:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378206.154129:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378206.154154:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 8 pid: 6588 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.154169:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 8 pid: 6588 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.154206:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787378206.154211:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787378206.154218:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.154247:0:8358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.154269:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378206.154329:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604581376:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 223us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378206.154337:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00010000:00010000:2.0:1787378206.156171:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036fbce23/0xdd3c5462d78534df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd2 expref: 7 pid: 6588 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378206.156194:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626612096:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378206.156234:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156310:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156319:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156356:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156365:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156373:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156380:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0400 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378206.156384:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156415:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156434:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.156443:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003595ccb2/0xdd3c5462d7853502 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.157126:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2355:x1874201604581248:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 7232us (9291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378206.157139:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:1.0:1787378206.174323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378206.174398:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604581632 00000100:00100000:3.0:1787378206.174410:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604581632 00000100:00100000:3.0:1787378206.174480:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:3.0:1787378206.174491:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10533:x1874201604581632:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787378206.174584:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.174601:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.174613:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.175085:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.175099:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.175115:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.175155:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.175170:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 15 pid: 5791 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378206.175185:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626612224:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378206.175353:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378206.179549:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626612224:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378206.179591:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378206.180190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378206.180296:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604581760 00000100:00100000:2.0:1787378206.180304:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604581760 00010000:00010000:2.0:1787378206.180339:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 16 pid: 5791 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378206.180380:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1787378206.180399:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+16:2353:x1874201604581760:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378206.180415:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378206.180421:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 16 pid: 5791 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.180433:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 16 pid: 5791 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.180456:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78534c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fbd expref: 16 pid: 5791 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.180472:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:2.0:1787378206.180477:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.180487:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.180495:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.180520:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378206.180581:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:2353:x1874201604581760:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 192us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378206.180589:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00010000:00010000:3.0:1787378206.180785:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378206.180795:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787378206.180980:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787378206.181144:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787378206.181191:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787378206.181413:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50de300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626612352:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787378206.181576:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378206.181608:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb85693480 going to sleep for 11 seconds 00000100:00100000:2.0:1787378206.181850:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626612352 00000100:00100000:2.0:1787378206.181855:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626612352 00000100:00100000:2.0:1787378206.181891:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787378206.181898:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9982:x1874201626612352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787378206.181977:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9982:x1874201626612352:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378206.181983:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378206.182206:0:9982:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787378206.182213:0:9982:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1787378206.182382:0:9982:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eeb901f9c00, transno 4294967309 00000004:00080000:1.0:1787378206.182404:0:9982:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eeb901f8380, transno 4294967310 00000100:00100000:1.0:1787378206.182412:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50de300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626612352:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787378206.184810:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787378206.184915:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626612480:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787378206.185525:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378206.185619:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb87817540 going to sleep for 11 seconds 00000100:00100000:2.0:1787378206.189412:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626612480 00000100:00100000:2.0:1787378206.189426:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626612480 00000100:00100000:0.0:1787378206.189934:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787378206.189946:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9982:x1874201626612480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787378206.190246:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9982:x1874201626612480:12345-0@lo:1000:mdt00_003.0 Request processed in 303us (5263us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787378206.190254:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787378206.190319:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626612480:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787378206.190379:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190391:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190399:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190405:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378206.190411:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190418:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190434:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeba261e500) 00010000:00010000:1.0:1787378206.190437:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378206.190441:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190447:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853510 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190506:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190512:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190518:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190522:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378206.190525:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190531:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190539:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:1.0:1787378206.190542:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378206.190549:0:9982:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa1 expref: 18 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190561:0:9982:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa1 expref: 18 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190569:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa1 expref: 18 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.190601:0:9982:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa1 expref: 18 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378206.190629:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626612608:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787378206.190711:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378206.194928:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626612608:192.168.203.22@tcp:105: 00010000:00010000:2.0:1787378206.194961:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.194972:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853453 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378206.195089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:2.0:1787378206.195219:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195239:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195248:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195264:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195288:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195293:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195299:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378206.195303:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195310:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195322:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378206.195324:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378206.195328:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195332:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853517 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195344:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195350:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195356:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195361:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378206.195371:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195378:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195386:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378206.195389:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787378206.195391:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.195397:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d7853509 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378206.195643:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:10533:x1874201604581632:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 21152us (21327us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787378206.195654:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000020:00080000:2.0:1787378206.195662:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787378206.196009:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787378206.196015:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787378206.196443:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787378206.196453:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787378206.199453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378206.204739:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604581888 00000100:00100000:0.0:1787378206.204755:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604581888 00000100:00100000:0.0:1787378206.204808:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604582144 00000100:00100000:0.0:1787378206.204812:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604582144 00000100:00100000:0.0:1787378206.204835:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787378206.204845:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10532:x1874201604581888:12345-192.168.203.22@tcp:49:lfs.0 00000100:00100000:0.0:1787378206.204984:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:10532:x1874201604581888:12345-192.168.203.22@tcp:49:lfs.0 Request processed in 140us (9896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378206.205017:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787378206.205035:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1787378206.205041:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:10533:x1874201604582144:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787378206.207764:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787378206.207887:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787378206.207944:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.207961:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.207972:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.208137:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.208146:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.208153:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.209915:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787378206.210107:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10533:x1874201604582144:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 5059us (10658us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787378206.210118:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000020:00080000:0.0:1787378206.210124:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787378206.210684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378206.213132:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604582400 00000100:00100000:2.0:1787378206.213147:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604582400 00000100:00100000:2.0:1787378206.213370:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:2.0:1787378206.213384:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10532:x1874201604582400:12345-192.168.203.22@tcp:58:lfs.0 00000040:00080000:2.0:1787378206.213747:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787378206.213916:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10532:x1874201604582400:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 534us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378206.213926:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00010000:00010000:1.0:1787378206.214413:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378206.214423:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.214435:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378206.214440:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.214450:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.214479:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:1.0:1787378206.214483:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787378206.214488:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.214494:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785351e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.214513:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378206.214515:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378206.214517:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378206.255816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378206.255909:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604582528 00000100:00100000:0.0:1787378206.255933:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604582528 00000100:00100000:0.0:1787378206.256010:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:0.0:1787378206.256019:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:10535:x1874201604582528:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378206.256046:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378206.256066:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853525 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fd9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256132:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256146:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256158:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256175:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256181:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256187:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256509:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256521:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256531:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256572:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378206.256587:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 21 pid: 5792 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378206.256602:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae373480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626612736:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378206.257593:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787378206.259405:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae373480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626612736:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378206.259434:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378206.261648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378206.262013:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604582784 00000100:00100000:0.0:1787378206.262024:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604582784 00000100:00100000:0.0:1787378206.262081:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1787378206.262091:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:5567:x1874201604582784:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787378206.262678:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:5567:x1874201604582784:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 587us (1037us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787378206.262688:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1787378206.266348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378206.266519:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604582912 00000100:00100000:1.0:1787378206.266529:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604582912 00010000:00010000:1.0:1787378206.266570:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 23 pid: 5792 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378206.266647:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1787378206.266657:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb907a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:2353:x1874201604582912:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378206.266671:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378206.266678:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 23 pid: 5792 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.266691:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 23 pid: 5792 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.266713:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853445 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f9a expref: 23 pid: 5792 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.266750:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:1.0:1787378206.266755:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.266765:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.266773:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378206.266802:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378206.266852:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb907a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:2353:x1874201604582912:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 196us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378206.266873:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00010000:00010000:2.0:1787378206.268029:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268044:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378206.268087:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787378206.268092:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378206.268111:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268128:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268139:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268146:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268153:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268174:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378206.268178:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268186:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268206:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:2.0:1787378206.268224:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378206.268229:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268235:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785352c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268558:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268566:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268572:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268578:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378206.268581:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268587:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268597:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eeb829cd600) 00010000:00010000:2.0:1787378206.268599:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378206.268602:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268608:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268651:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853525 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd9 expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268680:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd9 expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378206.268687:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378206.268689:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378206.268692:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a000, rc 0) 00000100:00100000:2.0:1787378206.268820:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10535:x1874201604582528:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 12800us (13010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378206.268830:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00010000:00010000:1.0:1787378206.687152:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787378206.987936:0:11902:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787378206.987947:0:11902:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787378206.987997:0:11902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787378206.988003:0:11902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787378207.258102:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787378207.258112:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787378207.258170:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787378207.258178:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787378207.258321:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626612864:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787378207.258598:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6eecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378207.260793:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626612864:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787378207.262347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378207.262454:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604583040 00000100:00100000:0.0:1787378207.262463:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604583040 00000100:00100000:0.0:1787378207.262538:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:0.0:1787378207.262550:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10547:x1874201604583040:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787378207.262590:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787378207.262699:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10547:x1874201604583040:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 151us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378207.262708:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00080000:1.0:1787378207.263902:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378207.268927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378207.269090:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604583296 00000100:00100000:2.0:1787378207.269101:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604583296 00000100:00100000:2.0:1787378207.269163:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:2.0:1787378207.269174:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:10547:x1874201604583296:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378207.269226:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378207.269250:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853541 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fe0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378207.269360:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378207.269376:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378207.269390:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378207.269403:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787378207.269556:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853541 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fe0 expref: 24 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378207.269577:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fe0 expref: 23 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378207.269587:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:2.0:1787378207.269591:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378207.269594:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0c00, rc 0) 00000100:00100000:2.0:1787378207.269664:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:10547:x1874201604583296:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 491us (746us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787378207.269672:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:0.0:1787378207.276625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378207.277083:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604583424 00000100:00100000:1.0:1787378207.277092:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604583424 00000100:00100000:1.0:1787378207.277155:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787378207.277163:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:2353:x1874201604583424:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378207.277177:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378207.277211:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fe0 expref: 23 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378207.277230:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:1.0:1787378207.277234:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378207.277376:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:2353:x1874201604583424:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 212us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378207.277384:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1787378207.287959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378207.288107:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604583680 00000100:00100000:0.0:1787378207.288117:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604583680 00000100:00100000:0.0:1787378207.288186:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:0.0:1787378207.288206:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:10547:x1874201604583680:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787378207.288281:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288300:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288312:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288505:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288514:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288521:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288527:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378207.288532:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288539:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288552:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:0.0:1787378207.288556:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787378207.288573:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378207.288580:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853556 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378207.288767:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:10547:x1874201604583680:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 561us (817us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787378207.288777:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000040:00080000:1.0:1787378207.289021:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787378207.289026:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787378207.289472:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787378207.289482:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787378207.292349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378207.292437:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604583936 00000100:00100000:3.0:1787378207.292456:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604583936 00000100:00100000:3.0:1787378207.292550:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1787378207.292561:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:10547:x1874201604583936:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787378207.292828:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:10547:x1874201604583936:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 269us (488us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787378207.292836:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00010000:00010000:0.0:1787378207.708317:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378207.769959:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626613248:0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.770035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378207.770094:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787378207.770101:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626613120:0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.770124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378207.770157:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626613632:0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.770181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378207.770222:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626613632 00000100:00100000:1.0:1787378207.770229:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626613632 00000100:00100000:1.0:1787378207.770271:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787378207.770292:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874201626613632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.770342:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874201626613632:12345-0@lo:400:kworker.0 Request processed in 64us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378207.770354:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787378207.770377:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626613248 00000100:00100000:1.0:1787378207.770381:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626613248 00000100:00100000:1.0:1787378207.770427:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626613120 00000100:00100000:1.0:1787378207.770431:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626613120 00000100:00100000:1.0:1787378207.770447:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787378207.770453:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626613248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787378207.770484:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378207.770487:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626613248:12345-0@lo:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378207.770495:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787378207.770508:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787378207.770513:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626613120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.770536:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626613120:12345-0@lo:400:kworker.0 Request processed in 22us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378207.770541:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787378207.770581:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626613120:0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.770591:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626613632:0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.770600:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626613248:0@lo:400:kworker.0 00000100:00100000:2.0:1787378207.770959:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626613376:0@lo:400:kworker.0 00000100:00100000:2.0:1787378207.771001:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378207.771035:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787378207.771041:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626612992:0@lo:400:kworker.0 00000100:00100000:2.0:1787378207.771067:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378207.771097:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626613504:0@lo:400:kworker.0 00000100:00100000:2.0:1787378207.771117:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378207.771180:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626613504 00000100:00100000:2.0:1787378207.771195:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626613504 00000100:00100000:2.0:1787378207.771229:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787378207.771236:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626613504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378207.771273:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626613504:12345-0@lo:400:kworker.0 Request processed in 38us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378207.771291:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1787378207.771310:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378207.771329:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626613504:0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.772068:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626613376 00000100:00100000:1.0:1787378207.772075:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626613376 00000100:00100000:3.0:1787378207.772199:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626612992 00000100:00100000:3.0:1787378207.772204:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626612992 00000100:00100000:3.0:1787378207.772233:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787378207.772239:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626612992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378207.772285:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626612992:12345-0@lo:400:kworker.0 Request processed in 46us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378207.772292:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787378207.773005:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787378207.773018:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626613376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378207.773066:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626613376:12345-0@lo:400:kworker.0 Request processed in 52us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378207.773071:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787378207.773134:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378207.773168:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626612992:0@lo:400:kworker.0 00000100:00100000:2.0:1787378207.773181:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626613376:0@lo:400:kworker.0 00000100:00100000:2.0:1787378208.282162:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626613760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378208.282234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378208.282401:0:11748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626613760 00000100:00100000:0.0:1787378208.282408:0:11748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626613760 00000100:00100000:0.0:1787378208.282456:0:11748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787378208.282464:0:11748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874201626613760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378208.282498:0:11748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378208.282536:0:11748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874201626613760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378208.282543:0:11748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787378208.282625:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626613760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378208.283500:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626613888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378208.283542:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378208.283626:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626613888 00000100:00100000:1.0:1787378208.283632:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626613888 00000100:00100000:1.0:1787378208.283686:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787378208.283693:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626613888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787378208.283738:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787378208.283801:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378208.284044:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626613888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 350us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378208.284051:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787378208.284174:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626613888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378208.731645:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787378209.097270:0:11953:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787378209.097291:0:11953:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787378209.097355:0:11953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787378209.097362:0:11953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787378209.361306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378209.361575:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604584192 00000100:00100000:3.0:1787378209.361589:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604584192 00000100:00100000:3.0:1787378209.361677:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:3.0:1787378209.361690:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:10567:x1874201604584192:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378209.361748:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378209.361777:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785355d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fe7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378209.361914:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853564 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378209.361934:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853564 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378209.361950:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853564 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378209.361987:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787378209.362148:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d785355d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fe7 expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378209.362173:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853564 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fe7 expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378209.362195:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378209.362198:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787378209.362202:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05a00, rc 0) 00000100:00080000:0.0:1787378209.363170:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378209.363596:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10567:x1874201604584192:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1901us (2308us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787378209.363610:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:2.0:1787378209.370129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378209.370629:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604584320 00000100:00100000:0.0:1787378209.370644:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604584320 00000100:00100000:0.0:1787378209.370749:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:0.0:1787378209.370761:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10567:x1874201604584320:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787378209.370856:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.370877:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.370915:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.370949:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.370958:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.370966:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.370972:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378209.370977:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.370986:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.371000:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:0.0:1787378209.371004:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378209.371010:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378209.371017:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378209.371120:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:10567:x1874201604584320:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 360us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378209.371129:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:3.0:1787378209.498875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378209.499113:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604584448 00000100:00100000:1.0:1787378209.499127:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604584448 00000100:00100000:1.0:1787378209.499227:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1787378209.499240:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604584448:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:1.0:1787378209.499266:0:8120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378209.499296:0:8120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4eaa0d7/0xdd3c5462d7853579 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6fee expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787378209.499336:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a893a1d, atime: 0x6a893a1d, ctime: 0x6a893a1d, blocks: 0xb 00010000:00010000:1.0:1787378209.499363:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1787378209.499388:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378209.499400:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4eaa0d7/0xdd3c5462d7853579 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fee expref: 7 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378209.499428:0:8120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4eaa0d7/0xdd3c5462d7853579 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fee expref: 7 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378209.499446:0:8120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546e00, rc 0) 00000100:00100000:1.0:1787378209.499529:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604584448:12345-192.168.203.22@tcp:101:cat.0 Request processed in 291us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378209.499540:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00080000:0.0:1787378209.500433:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378209.527223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378209.527355:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604584576 00000100:00100000:0.0:1787378209.527367:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604584576 00002000:00100000:0.0:1787378209.527431:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9eeb867dbb80 x1874201604584576/t0(0) o3->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:280/0 lens 488/0 e 0 to 0 dl 1787378220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378209.527443:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb867dbb80 with x1874201604584576 ext(0->4095) 00002000:00010000:0.0:1787378209.527450:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eeb867dbb80 00000100:00100000:0.0:1787378209.527482:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1787378209.527491:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604584576:12345-192.168.203.22@tcp:3:cat.0 00000100:00100000:0.0:1787378209.528046:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604584576:12345-192.168.203.22@tcp:3:cat.0 Request processed in 552us (834us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787378209.528056:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00002000:00100000:0.0:1787378209.528063:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9eeb867dbb80 x1874201604584576/t0(0) o3->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:280/0 lens 488/4536 e 0 to 0 dl 1787378220 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378209.528071:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb867dbb80 with x1874201604584576 ext(0->4095) 00002000:00010000:0.0:1787378209.528075:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eeb867dbb80 00010000:00010000:1.0:1787378209.754582:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378210.435496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378210.435549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378210.435590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378210.435609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378210.435639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378210.435686:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604584960 00000100:00100000:2.0:1787378210.435699:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604584960 00000100:00100000:2.0:1787378210.435805:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604585088 00000100:00100000:2.0:1787378210.435809:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604585088 00000100:00100000:2.0:1787378210.435835:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1787378210.435846:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604584960:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378210.436204:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604584960:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 357us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378210.436213:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1787378210.436236:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:2.0:1787378210.436245:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604585088:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378210.436274:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604585088:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378210.436280:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:0.0:1787378210.436471:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604584704 00000100:00100000:0.0:1787378210.436476:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604584704 00000100:00100000:0.0:1787378210.436519:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00100000:0.0:1787378210.436527:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604584704:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378210.436565:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb86776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604584704:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378210.436571:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00080000:0.0:1787378210.436602:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787378210.437095:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604585216 00000100:00100000:3.0:1787378210.437102:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604585216 00000100:00100000:3.0:1787378210.437160:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604584832 00000100:00100000:3.0:1787378210.437164:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604584832 00000100:00100000:3.0:1787378210.437202:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:3.0:1787378210.437210:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604585216:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378210.437251:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604585216:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 43us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378210.437258:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:3.0:1787378210.437272:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:3.0:1787378210.437278:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:2355:x1874201604584832:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378210.437329:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:2355:x1874201604584832:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 51us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378210.437336:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00080000:0.0:1787378210.437576:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787378210.779355:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787378210.935208:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787378211.436694:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787378211.436750:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787378211.440953:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1787378211.441093:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eeb87461f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787378211.441099:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb84dade00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb87461c00 00000020:00080000:2.0:1787378211.441103:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb84dad900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb99ca3800 00000020:00080000:2.0:1787378211.441123:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787378211.441142:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000001:00080000:2.0:1787378211.441143:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787378211.441604:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787378211.804491:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378212.826165:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378212.891537:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626614016:0@lo:400:kworker.0 00000100:00100000:1.0:1787378212.891631:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378212.891686:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626614528:0@lo:400:kworker.0 00000100:00100000:1.0:1787378212.891712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378212.891770:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378212.891776:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626614400:0@lo:400:kworker.0 00000100:00100000:1.0:1787378212.891800:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378212.891836:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626614016 00000100:00100000:1.0:1787378212.891846:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626614016 00000100:00100000:1.0:1787378212.891905:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787378212.891927:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626614016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378212.892054:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626614016:12345-0@lo:400:kworker.0 Request processed in 127us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378212.892062:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787378212.892102:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626614528 00000100:00100000:1.0:1787378212.892105:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626614528 00000100:00100000:1.0:1787378212.892143:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787378212.892159:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626614528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378212.892191:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626614528:12345-0@lo:400:kworker.0 Request processed in 42us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378212.892197:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1787378212.892218:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378212.892263:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626614016:0@lo:400:kworker.0 00000100:00100000:1.0:1787378212.892279:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626614528:0@lo:400:kworker.0 00000100:00100000:3.0:1787378212.893102:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626614272:0@lo:400:kworker.0 00000100:00100000:3.0:1787378212.893161:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378212.893305:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626614144:0@lo:400:kworker.0 00000100:00100000:2.0:1787378212.893338:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378212.893363:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626614656:0@lo:400:kworker.0 00000100:00100000:2.0:1787378212.893388:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378212.895652:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626614400 00000100:00100000:2.0:1787378212.895672:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626614400 00000100:00100000:2.0:1787378212.895765:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626614656 00000100:00100000:2.0:1787378212.895770:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626614656 00000100:00100000:2.0:1787378212.895800:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787378212.895813:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626614400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378212.895918:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626614400:12345-0@lo:400:kworker.0 Request processed in 109us (4116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378212.895927:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787378212.896091:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626614272 00000100:00100000:3.0:1787378212.896096:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626614272 00000100:00100000:3.0:1787378212.896162:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626614144 00000100:00100000:3.0:1787378212.896166:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626614144 00000100:00100000:3.0:1787378212.896188:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787378212.896195:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626614272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378212.896237:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626614272:12345-0@lo:400:kworker.0 Request processed in 43us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378212.896244:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787378212.896259:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787378212.896266:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626614144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378212.896300:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626614144:12345-0@lo:400:kworker.0 Request processed in 35us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378212.896306:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787378212.896328:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787378212.896335:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626614656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378212.896367:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626614656:12345-0@lo:400:kworker.0 Request processed in 33us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378212.896373:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787378212.897841:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626614144:0@lo:400:kworker.0 00000100:00100000:1.0:1787378212.897861:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787378212.897867:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787378212.897893:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626614656:0@lo:400:kworker.0 00000100:00080000:1.0:1787378212.898172:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787378212.898180:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378212.898183:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378212.898213:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787378212.898219:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eebb53efb80, transno 4294967304 00000100:00100000:1.0:1787378212.898242:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626614400:0@lo:400:kworker.0 00000100:00100000:3.0:1787378212.898350:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626614272:0@lo:400:kworker.0 00000100:00100000:1.0:1787378213.402357:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787378213.402494:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eea830d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626614784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378213.402591:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378213.402684:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626614912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378213.402715:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378213.402875:0:11748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626614784 00000100:00100000:0.0:1787378213.402892:0:11748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626614784 00000100:00100000:0.0:1787378213.402949:0:11748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626614912 00000100:00100000:0.0:1787378213.402952:0:11748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626614912 00000100:00100000:0.0:1787378213.402970:0:11748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787378213.402979:0:11748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626614784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378213.403021:0:11748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378213.403076:0:11748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626614784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378213.403085:0:11748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787378213.403103:0:11748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787378213.403109:0:11748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626614912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378213.403139:0:11748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378213.403180:0:11748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626614912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378213.403186:0:11748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787378213.403372:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eea830d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626614784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378213.403549:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626614912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787378213.854944:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787378214.491317:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378214.491330:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378214.491716:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787378214.491755:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787378214.873912:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378215.076283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378215.076380:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604585344 00000100:00100000:3.0:1787378215.076394:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604585344 00000100:00100000:3.0:1787378215.076555:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:3.0:1787378215.076567:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10220:x1874201604585344:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1787378215.076828:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378215.076931:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10220:x1874201604585344:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 365us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378215.076941:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:2.0:1787378215.089254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378215.089430:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604585600 00000100:00100000:3.0:1787378215.089443:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604585600 00000100:00100000:3.0:1787378215.089527:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1787378215.089539:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:10220:x1874201604585600:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787378215.092500:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:10220:x1874201604585600:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 2257us (2555us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787378215.092523:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1787378215.366508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378215.371015:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604585728 00000100:00100000:3.0:1787378215.371039:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604585728 00000100:00100000:3.0:1787378215.371622:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:3.0:1787378215.371635:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:11021:x1874201604585728:12345-192.168.203.22@tcp:101:lsof.0 00010000:00010000:3.0:1787378215.371661:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378215.371697:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ff5 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378215.371845:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378215.371862:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378215.371875:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378215.372180:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787378215.372185:0:9982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378215.372297:0:9982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378215.372330:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 7 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378215.372349:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 6 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378215.372360:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:3.0:1787378215.372363:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378215.372368:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05000, rc 0) 00000100:00100000:3.0:1787378215.372462:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:11021:x1874201604585728:12345-192.168.203.22@tcp:101:lsof.0 Request processed in 829us (5978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378215.372471:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00080000:1.0:1787378215.373220:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378215.545497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378215.545595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378215.545633:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378215.545769:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604586240 00000100:00100000:3.0:1787378215.545783:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604586240 00000100:00100000:3.0:1787378215.545895:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:3.0:1787378215.545908:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604586240:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378215.546009:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604586240:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 104us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378215.546019:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:0.0:1787378215.546354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378215.546395:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604586112 00000100:00100000:0.0:1787378215.546400:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604586112 00000100:00100000:0.0:1787378215.546437:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:0.0:1787378215.546445:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604586112:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378215.552398:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604585856 00000100:00100000:1.0:1787378215.552420:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604585856 00000100:00100000:1.0:1787378215.552508:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 293 00000100:00100000:1.0:1787378215.552521:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2353:x1874201604585856:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378215.552676:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604586112:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 6226us (6318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378215.552701:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:2.0:1787378215.554031:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604585984 00000100:00100000:2.0:1787378215.554047:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604585984 00000100:00100000:2.0:1787378215.554119:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:2.0:1787378215.554129:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:2353:x1874201604585984:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:3.0:1787378215.554654:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787378215.554661:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378215.554743:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2353:x1874201604585856:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 2220us (9104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378215.554756:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 293 00000100:00100000:2.0:1787378215.561881:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:2353:x1874201604585984:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 7509us (16156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378215.561931:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 145 00010000:00010000:3.0:1787378215.898559:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787378216.554798:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1787378216.554849:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787378216.554909:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787378216.554924:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787378216.922271:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378217.945931:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378218.011379:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787378218.011444:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378218.011473:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626615168:0@lo:400:kworker.0 00000100:00100000:2.0:1787378218.011576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378218.011705:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626615168 00000100:00100000:0.0:1787378218.011716:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626615168 00000100:00100000:0.0:1787378218.011812:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787378218.011822:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626615168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378218.012048:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626615168:0@lo:400:kworker.0 00000100:00100000:0.0:1787378218.012101:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626615168:12345-0@lo:400:kworker.0 Request processed in 85us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378218.012110:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787378218.016003:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626615040:0@lo:400:kworker.0 00000100:00100000:1.0:1787378218.016131:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378218.016537:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626615424:0@lo:400:kworker.0 00000100:00100000:3.0:1787378218.016590:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378218.016619:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787378218.016624:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626615296:0@lo:400:kworker.0 00000100:00100000:3.0:1787378218.016653:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378218.016689:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626615424 00000100:00100000:3.0:1787378218.016698:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626615424 00000100:00100000:2.0:1787378218.017034:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626615552:0@lo:400:kworker.0 00000100:00100000:2.0:1787378218.017070:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378218.017092:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378218.017098:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626615680:0@lo:400:kworker.0 00000100:00100000:2.0:1787378218.017128:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378218.017216:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626615040 00000100:00100000:0.0:1787378218.017221:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626615040 00000100:00100000:0.0:1787378218.017253:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787378218.017263:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626615040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378218.017325:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626615040:12345-0@lo:400:kworker.0 Request processed in 62us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378218.017334:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787378218.017445:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626615040:0@lo:400:kworker.0 00000100:00080000:1.0:1787378218.017502:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378218.017533:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626615296 00000100:00100000:1.0:1787378218.017536:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626615296 00000100:00100000:1.0:1787378218.017576:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626615552 00000100:00100000:1.0:1787378218.017579:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626615552 00000100:00100000:1.0:1787378218.017596:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787378218.017602:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626615296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378218.017640:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626615296:12345-0@lo:400:kworker.0 Request processed in 38us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378218.017645:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787378218.017656:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787378218.017660:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626615552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378218.017683:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626615552:12345-0@lo:400:kworker.0 Request processed in 22us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378218.017688:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1787378218.017702:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378218.017775:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626615296:0@lo:400:kworker.0 00000100:00100000:2.0:1787378218.018361:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626615552:0@lo:400:kworker.0 00000100:00100000:3.0:1787378218.018883:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626615680 00000100:00100000:3.0:1787378218.018891:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626615680 00000100:00100000:3.0:1787378218.018955:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787378218.018965:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626615424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378218.019038:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626615424:12345-0@lo:400:kworker.0 Request processed in 75us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378218.019045:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787378218.019062:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787378218.019068:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626615680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378218.019100:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626615680:12345-0@lo:400:kworker.0 Request processed in 32us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378218.019106:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787378218.019160:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626615424:0@lo:400:kworker.0 00000100:00080000:2.0:1787378218.019262:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787378218.019285:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626615680:0@lo:400:kworker.0 00000100:00100000:2.0:1787378218.525530:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbac5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626615808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378218.525958:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378218.526136:0:11748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626615808 00000100:00100000:2.0:1787378218.526145:0:11748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626615808 00000100:00100000:2.0:1787378218.526202:0:11748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787378218.526210:0:11748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626615808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787378218.526256:0:11748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378218.526299:0:11748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626615808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378218.527140:0:11748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787378218.527226:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbac5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626615808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378218.529885:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626615936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378218.530379:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378218.535343:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626615936 00000100:00100000:3.0:1787378218.535361:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626615936 00000100:00100000:3.0:1787378218.535565:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787378218.535577:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626615936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378218.535628:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378218.535764:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626615936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (5385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378218.535772:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787378218.535805:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626615936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787378218.970138:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787378219.247865:0:12156:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:56:57 (1787378217) 00010000:00010000:2.0:1787378219.999150:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378220.672241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378220.672297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378220.672328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378220.672426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378220.672454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378220.672489:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604586368 00000100:00100000:0.0:1787378220.672489:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604586624 00000100:00100000:1.0:1787378220.672502:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604586368 00000100:00100000:0.0:1787378220.672502:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604586624 00000100:00100000:0.0:1787378220.672567:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604586752 00000100:00100000:0.0:1787378220.672571:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604586752 00000100:00100000:1.0:1787378220.672576:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:1.0:1787378220.672591:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604586368:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378220.672604:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:0.0:1787378220.672615:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604586624:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378220.672704:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604586368:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 116us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378220.672713:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:2.0:1787378220.672748:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604586880 00000100:00100000:2.0:1787378220.672755:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604586880 00000100:00100000:2.0:1787378220.672818:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604586496 00000100:00100000:2.0:1787378220.672822:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604586496 00000100:00100000:3.0:1787378220.672898:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:3.0:1787378220.672909:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604586752:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378220.672941:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604586752:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378220.672948:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00080000:3.0:1787378220.673128:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787378220.673133:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787378220.673135:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787378220.673676:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2356:x1874201604586624:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1060us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378220.673704:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1787378220.676658:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:1.0:1787378220.676692:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2356:x1874201604586880:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378220.677001:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2356:x1874201604586880:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 327us (4670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378220.677027:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:1.0:1787378220.677071:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:1.0:1787378220.677081:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:2356:x1874201604586496:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378220.677123:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:2356:x1874201604586496:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 44us (4697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378220.677130:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00010000:00010000:1.0:1787378221.017895:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378221.048367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378221.050922:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604587136 00000100:00100000:1.0:1787378221.050944:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604587136 00000100:00100000:1.0:1787378221.051181:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:1.0:1787378221.051195:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:11287:x1874201604587136:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378221.051233:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378221.051268:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785358e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a6ffc expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.051371:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.051387:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.051400:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.051428:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.051435:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.051460:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.053874:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78535a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.053903:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78535a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.053916:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78535a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378221.053931:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787378221.057900:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.057925:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.057935:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.057943:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378221.057948:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.057957:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.057978:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:1.0:1787378221.057982:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378221.058005:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.058010:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853595 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.058029:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.058034:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.058039:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.058044:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378221.058941:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.058959:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.058973:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eeb85524d00) 00010000:00010000:1.0:1787378221.058976:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378221.058981:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.058989:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785359c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.059869:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785358e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ffc expref: 16 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.060412:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78535a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ffc expref: 15 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.060423:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:1.0:1787378221.060426:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378221.060430:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81546200, rc 0) 00000100:00100000:1.0:1787378221.060629:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:11287:x1874201604587136:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 9434us (12401us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787378221.060641:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:0.0:1787378221.064251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378221.064315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378221.064761:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604587264 00000100:00100000:1.0:1787378221.064774:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604587264 00000100:00100000:1.0:1787378221.064847:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1787378221.064859:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:2356:x1874201604587264:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378221.064879:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378221.064912:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78535a3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ffc expref: 15 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378221.064933:0:8358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:1.0:1787378221.064940:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378221.065012:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:2356:x1874201604587264:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 154us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378221.065020:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787378221.065454:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604587392 00000100:00100000:2.0:1787378221.065460:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604587392 00000100:00100000:2.0:1787378221.065512:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:2.0:1787378221.065520:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:11287:x1874201604587392:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787378221.065618:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:11287:x1874201604587392:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 99us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378221.065626:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 138 00000040:00080000:3.0:1787378221.658801:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378221.658817:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378221.660636:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787378221.660668:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787378221.706268:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:2.0:1787378222.043078:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378223.072237:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378223.134549:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626616064:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.134618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378223.134681:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626616576:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.134707:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378223.134751:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787378223.134758:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626616192:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.134796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378223.134812:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626616704:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.134832:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378223.134854:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626616320:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.134876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378223.134894:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378223.134899:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626616448:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.134920:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378223.134954:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626616064 00000100:00100000:2.0:1787378223.134961:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626616064 00000100:00100000:2.0:1787378223.135003:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787378223.135014:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626616064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135062:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626616064:12345-0@lo:400:kworker.0 Request processed in 51us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.135069:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787378223.135111:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626616576 00000100:00100000:2.0:1787378223.135114:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626616576 00000100:00100000:2.0:1787378223.135144:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787378223.135151:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626616576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135181:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626616576:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.135187:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787378223.135197:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626616192 00000100:00100000:2.0:1787378223.135199:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626616192 00000100:00100000:2.0:1787378223.135211:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626616320 00000100:00100000:2.0:1787378223.135213:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626616320 00000100:00100000:2.0:1787378223.135227:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787378223.135241:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626616192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135269:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626616192:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.135274:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787378223.135287:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787378223.135292:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626616320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135321:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626616320:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.135326:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787378223.135344:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626616704 00000100:00100000:2.0:1787378223.135348:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626616704 00000100:00100000:2.0:1787378223.135371:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626616448 00000100:00100000:2.0:1787378223.135374:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626616448 00000100:00100000:2.0:1787378223.135391:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787378223.135396:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626616704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135442:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626616704:12345-0@lo:400:kworker.0 Request processed in 46us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.135448:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787378223.135458:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787378223.135464:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626616448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135488:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626616448:12345-0@lo:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.135493:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1787378223.135511:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378223.135515:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378223.135517:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378223.135542:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626616448:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135561:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626616320:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135588:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626616192:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135597:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626616704:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135604:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626616064:0@lo:400:kworker.0 00000100:00100000:2.0:1787378223.135612:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626616576:0@lo:400:kworker.0 00000100:00100000:3.0:1787378223.230493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.230541:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604587520 00000100:00100000:2.0:1787378223.230550:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604587520 00000100:00100000:2.0:1787378223.230630:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:2.0:1787378223.230642:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:11329:x1874201604587520:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378223.230661:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.230681:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7003 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.230764:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.230780:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.230790:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.230804:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.230811:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.230825:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231100:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231108:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231115:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231120:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378223.231125:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231133:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231144:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378223.231146:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378223.231150:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231156:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231165:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231171:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231183:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231187:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378223.231190:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231196:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231204:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eeba261e700) 00010000:00010000:2.0:1787378223.231206:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378223.231209:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231215:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78535bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231246:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7003 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231256:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378223.231259:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378223.231263:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7003 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.231272:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0a00, rc 0) 00000100:00100000:2.0:1787378223.231326:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:11329:x1874201604587520:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 686us (843us total) trans 0 rc 301/301 00000100:00100000:2.0:1787378223.231353:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00080000:3.0:1787378223.231757:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378223.243603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378223.243673:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604587776 00000100:00100000:3.0:1787378223.243684:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604587776 00000100:00100000:3.0:1787378223.243776:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:3.0:1787378223.243787:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:11329:x1874201604587776:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:1.0:1787378223.243923:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378223.243949:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebc21c7c00/0xdd3c5462d7852f2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e3c expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.243969:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:1.0:1787378223.243974:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787378223.244278:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.244292:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 5 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.244301:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.244332:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 5 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.244346:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 5 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.244360:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626616832:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378223.244448:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c59540 going to sleep for 11 seconds 00000100:00100000:3.0:1787378223.250277:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626616832:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378223.250307:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378223.252530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.252960:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604587904 00000100:00100000:1.0:1787378223.252969:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604587904 00010000:00010000:1.0:1787378223.253032:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 6 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.253089:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1787378223.253101:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2353:x1874201604587904:12345-192.168.203.22@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1787378223.253107:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787378223.253114:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378223.253128:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 6 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.253143:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 6 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.253165:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d7853587 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6ff5 expref: 6 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.253178:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:1.0:1787378223.253183:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.253192:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.253199:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.253230:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378223.253264:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.253274:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.253284:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604587904:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 185us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378223.253292:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00010000:00010000:2.0:1787378223.253298:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.253308:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.253317:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378223.257296:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787378223.257314:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.257325:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.257333:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.258518:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378223.258525:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.258545:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.258562:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378223.258565:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378223.258569:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.258575:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378223.258595:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091a0bcee reply state 000000006472793b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378223.258604:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378223.258755:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:11329:x1874201604587776:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 14966us (15157us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787378223.258765:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00010000:00010000:1.0:1787378223.266693:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.266709:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.266739:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.266757:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.266762:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.266770:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.266786:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eeba261e700) 00010000:00010000:1.0:1787378223.266789:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378223.266793:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.266800:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d78535cd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378223.364324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.364553:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604588032 00000100:00100000:2.0:1787378223.364563:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604588032 00000100:00100000:2.0:1787378223.364621:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:2.0:1787378223.364631:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:11337:x1874201604588032:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:2.0:1787378223.364656:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.365100:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a700a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.365297:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1200/0xdd3c5462d78535db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.365326:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1200/0xdd3c5462d78535db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.365337:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1200/0xdd3c5462d78535db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378223.365526:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787378223.365530:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378223.365552:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1200/0xdd3c5462d78535db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.365577:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a700a expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.365594:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1200/0xdd3c5462d78535db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a700a expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.365604:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378223.365607:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378223.365609:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1200, rc 0) 00000100:00100000:2.0:1787378223.365748:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:11337:x1874201604588032:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 1114us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.365757:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:2.0:1787378223.409784:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.409950:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604588160 00000100:00100000:1.0:1787378223.409960:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604588160 00000100:00100000:1.0:1787378223.410055:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:1.0:1787378223.410065:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+14:11343:x1874201604588160:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787378223.410095:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378223.410115:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78535e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410189:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410202:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410229:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410244:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410251:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410258:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410378:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410387:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410394:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378223.410423:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787378223.410427:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378223.410450:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410462:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410468:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410485:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410490:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.410494:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410502:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410514:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:1.0:1787378223.410517:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378223.410522:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410528:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78535e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410542:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410548:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410553:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410558:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.410561:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410579:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410587:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eeb85524d00) 00010000:00010000:1.0:1787378223.410590:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378223.410593:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410598:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78535f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410628:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78535e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7011 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410641:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7011 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.410647:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:1.0:1787378223.410650:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787378223.410652:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547200, rc 0) 00000100:00100000:1.0:1787378223.410765:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:11343:x1874201604588160:12345-192.168.203.22@tcp:101:bash.0 Request processed in 654us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378223.410774:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:3.0:1787378223.413373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.414115:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604588416 00000100:00100000:2.0:1787378223.414126:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604588416 00000100:00100000:2.0:1787378223.414715:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:2.0:1787378223.414749:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+15:11343:x1874201604588416:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787378223.414786:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.414808:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7018 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.414948:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.414962:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.414974:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.415032:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.415040:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.415048:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787378223.416279:0:9982:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787378223.416518:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416531:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416539:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416587:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416595:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416602:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416608:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378223.416612:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416619:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416631:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378223.416634:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378223.416638:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416644:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853605 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378223.416658:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f944d272 reply state 0000000006fd9cac transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378223.416667:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787378223.416698:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78535fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 18 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416748:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 17 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.416756:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:2.0:1787378223.416758:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378223.416761:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0800, rc 0) 00000100:00100000:2.0:1787378223.416834:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11343:x1874201604588416:12345-192.168.203.22@tcp:101:bash.0 Request processed in 2089us (3469us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787378223.416842:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 143 00010000:00010000:3.0:1787378223.422227:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.422241:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.422249:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.422254:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378223.422259:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.422266:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.422281:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeba261ee00) 00010000:00010000:3.0:1787378223.422284:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378223.422288:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.422310:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785360c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378223.422388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.422460:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604588544 00000100:00100000:1.0:1787378223.422468:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604588544 00000100:00100000:1.0:1787378223.422534:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1787378223.422544:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2354:x1874201604588544:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787378223.422570:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378223.422589:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a701f expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787378223.422613:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787378223.422630:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1787378223.422635:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378223.422645:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.422663:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.422675:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547400, rc 0) 00000100:00100000:1.0:1787378223.422776:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604588544:12345-192.168.203.22@tcp:101:bash.0 Request processed in 233us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378223.422784:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00080000:2.0:1787378223.422842:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378223.426206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.426289:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604588672 00000100:00100000:2.0:1787378223.426299:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604588672 00000100:00100000:2.0:1787378223.426368:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1787378223.426379:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:11343:x1874201604588672:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787378223.426396:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.426417:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7026 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.426447:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.426456:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378223.426461:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378223.426466:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.426514:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.426528:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 7 pid: 6588 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378223.426541:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1874201626616960:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378223.426627:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbac58300 going to sleep for 11 seconds 00000100:00100000:3.0:1787378223.429458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.429550:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1874201626616960:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378223.429582:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.429601:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0e00, rc 0) 00000100:00100000:2.0:1787378223.429658:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:11343:x1874201604588672:12345-192.168.203.22@tcp:101:bash.0 Request processed in 3280us (3460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.429667:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1787378223.429742:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604588800 00000100:00100000:0.0:1787378223.429749:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604588800 00010000:00010000:0.0:1787378223.429792:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 7 pid: 6588 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378223.429828:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1787378223.429838:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604588800:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378223.429853:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378223.429873:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 7 pid: 6588 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.429887:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 7 pid: 6588 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.429911:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a064e02/0xdd3c5462d7853621 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a701f expref: 7 pid: 6588 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.429926:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378223.429930:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378223.429938:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.429966:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.429998:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378223.430010:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae370380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5778:1874201626617088:192.168.203.22@tcp:105: 00000100:00100000:0.0:1787378223.430074:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb811ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378223.434178:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae370380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5778:1874201626617088:192.168.203.22@tcp:105: 00010000:00010000:0.0:1787378223.434205:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378223.434264:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604588800:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 4428us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378223.434276:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:3.0:1787378223.434954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.435019:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604589056 00000100:00100000:1.0:1787378223.435026:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604589056 00000100:00100000:1.0:1787378223.435089:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1787378223.435098:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:11343:x1874201604589056:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:1.0:1787378223.435434:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11343:x1874201604589056:12345-192.168.203.22@tcp:35:bash.0 Request processed in 336us (482us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787378223.435442:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1787378223.513555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.513650:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604589312 00000100:00100000:2.0:1787378223.513658:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604589312 00000100:00100000:2.0:1787378223.513715:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:2.0:1787378223.513750:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11353:x1874201604589312:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378223.513776:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.513796:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785362f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a702d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378223.513932:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787378223.514047:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785362f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a702d expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.514061:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378223.514064:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378223.514068:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785362f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a702d expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.514093:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0c00, rc 0) 00000100:00100000:2.0:1787378223.514152:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:11353:x1874201604589312:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 404us (606us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787378223.514812:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:3.0:1787378223.517490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.517706:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604589568 00000100:00100000:1.0:1787378223.517761:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604589568 00000100:00100000:1.0:1787378223.517814:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:1.0:1787378223.517824:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:11353:x1874201604589568:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378223.518086:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:11353:x1874201604589568:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 247us (590us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787378223.518095:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1787378223.580177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.580327:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604589696 00000100:00100000:2.0:1787378223.580336:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604589696 00000100:00100000:2.0:1787378223.580405:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:2.0:1787378223.580415:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:11359:x1874201604589696:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378223.580438:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.580459:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785363d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7034 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.580524:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853644 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.580538:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.580567:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378223.580623:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787378223.580627:0:9982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378223.580649:0:9982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.580676:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785363d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7034 expref: 22 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.580694:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853644 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7034 expref: 21 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.580703:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378223.580706:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378223.580710:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0000, rc 0) 00000100:00100000:2.0:1787378223.580818:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:11359:x1874201604589696:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 403us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.580825:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:3.0:1787378223.585092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.585368:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604589952 00000100:00100000:2.0:1787378223.585377:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604589952 00000100:00100000:2.0:1787378223.585435:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:2.0:1787378223.585445:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:11359:x1874201604589952:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378223.585466:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.585487:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785364b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a703b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.585604:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853652 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.585618:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.585630:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378223.585641:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787378223.585778:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785364b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a703b expref: 24 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.585796:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a703b expref: 23 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.585805:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:2.0:1787378223.585807:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378223.585811:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1000, rc 0) 00000100:00100000:2.0:1787378223.585870:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:11359:x1874201604589952:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 426us (805us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787378223.585877:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:3.0:1787378223.589594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378223.589639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378223.589759:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604590336 00000100:00100000:0.0:1787378223.589768:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604590336 00000100:00100000:0.0:1787378223.589823:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1787378223.589832:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:2356:x1874201604590336:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378223.589847:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378223.589883:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a703b expref: 23 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.589902:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:0.0:1787378223.589907:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378223.589975:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:2356:x1874201604590336:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 143us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378223.589983:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787378223.590537:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604590208 00000100:00100000:2.0:1787378223.590544:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604590208 00000100:00100000:2.0:1787378223.590582:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:2.0:1787378223.590589:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:11359:x1874201604590208:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378223.590608:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.590628:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0600/0xdd3c5462d7853660 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7042 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.590708:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853667 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.590742:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.590752:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378223.590764:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787378223.590893:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0600/0xdd3c5462d7853660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7042 expref: 25 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.590908:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853667 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7042 expref: 24 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.590915:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:2.0:1787378223.590918:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787378223.590920:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1400, rc 0) 00000100:00100000:2.0:1787378223.590953:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:11359:x1874201604590208:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 364us (1369us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787378223.590960:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:3.0:1787378223.598465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.598604:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604590464 00000100:00100000:1.0:1787378223.598614:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604590464 00000100:00100000:1.0:1787378223.598671:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:1.0:1787378223.598681:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604590464:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:1.0:1787378223.598764:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.598786:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.598795:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378223.598799:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787378223.598804:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.598838:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.598852:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 6 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.598892:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6588:1874201626617216:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378223.598975:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c59780 going to sleep for 11 seconds 00000100:00100000:3.0:1787378223.603298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.603552:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6588:1874201626617216:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378223.603579:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378223.604113:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604590592 00000100:00100000:0.0:1787378223.604121:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604590592 00002000:00100000:0.0:1787378223.604170:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9eebbb1e2300 x1874201604590592/t0(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:294/0 lens 504/0 e 0 to 0 dl 1787378234 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378223.604180:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebbb1e2300 with x1874201604590592 ext(0->12) 00010000:00010000:0.0:1787378223.604187:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 7 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.604202:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 7 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378223.604209:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9eebbb1e2300 00000100:00100000:0.0:1787378223.604230:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1787378223.604239:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604590592:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:0.0:1787378223.604975:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2354:x1874201604590592:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 734us (1683us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787378223.604984:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00002000:00100000:0.0:1787378223.604991:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9eebbb1e2300 x1874201604590592/t4294967305(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:294/0 lens 504/448 e 0 to 0 dl 1787378234 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378223.605000:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebbb1e2300 with x1874201604590592 ext(0->12) 00010000:00010000:0.0:1787378223.605007:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 9 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.605032:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 9 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378223.605040:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9eebbb1e2300 00000100:00100000:3.0:1787378223.608569:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.608666:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604590720 00000100:00100000:1.0:1787378223.608676:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604590720 00010000:00010000:1.0:1787378223.608715:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 9 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.608784:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:1.0:1787378223.608794:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2353:x1874201604590720:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378223.608811:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787378223.608829:0:5776:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787378223.608832:0:5776:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787378223 00002000:00010000:1.0:1787378223.608835:0:5776:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787378223 00002000:00010000:1.0:1787378223.608837:0:5776:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787378223 00010000:00010000:1.0:1787378223.608844:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 9 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.608857:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 9 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.608908:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b240a050/0xdd3c5462d7853628 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7026 expref: 9 pid: 6586 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.608923:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787378223.608928:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787378223.608934:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.608944:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.608980:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378223.609027:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604590720:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 235us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378223.609036:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00010000:00010000:3.0:1787378223.609255:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.609266:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.609291:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.609300:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.609307:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.609327:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378223.609332:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.609342:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.609355:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378223.609363:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000690fa1df/0xdd3c5462d7853675 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378223.609414:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604590464:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 10734us (10960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378223.609423:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787378223.612216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.612400:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604590976 00000100:00100000:1.0:1787378223.612409:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604590976 00000100:00100000:1.0:1787378223.612463:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1787378223.612473:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863ad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:11359:x1874201604590976:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:1.0:1787378223.612535:0:5793:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853667 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7042 expref: 24 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787378223.612816:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787378223.612866:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787378223.613396:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787378223.613454:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.613478:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 28 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.613488:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.613524:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 28 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.613539:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 28 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.613554:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5793:1874201626617344:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378223.613632:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c59780 going to sleep for 11 seconds 00000100:00100000:0.0:1787378223.616844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.616939:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604591104 00000100:00100000:2.0:1787378223.616948:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604591104 00010000:00010000:2.0:1787378223.616986:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 29 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378223.617043:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:2.0:1787378223.617053:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8a3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:2354:x1874201604591104:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378223.617088:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378223.617095:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 29 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.617107:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 29 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.617127:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:2.0:1787378223.617133:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.617141:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.617147:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.617174:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378223.617227:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8a3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:2354:x1874201604591104:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 175us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.617235:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00010000:00010000:1.0:1787378223.617930:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7018 expref: 28 pid: 9982 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.617949:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5793:1874201626617344:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378223.617971:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.617980:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.617987:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787378223.618255:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787378223.618464:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787378223.618560:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626617472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787378223.618612:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378223.618695:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207600 going to sleep for 11 seconds 00000100:00100000:3.0:1787378223.619497:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626617472 00000100:00100000:3.0:1787378223.619505:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626617472 00000100:00100000:3.0:1787378223.619592:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787378223.619601:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1874201626617472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787378223.619694:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1874201626617472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378223.619701:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787378223.619779:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626617472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787378223.620351:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787378223.620423:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626617600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787378223.620460:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378223.621526:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a2073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378223.621816:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626617600 00000100:00100000:0.0:1787378223.621823:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626617600 00000100:00100000:0.0:1787378223.621862:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787378223.621936:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5793:x1874201626617600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787378223.622316:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5793:x1874201626617600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 382us (1855us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787378223.622325:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787378223.622509:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1874201626617600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787378223.622571:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787378223.622621:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.622631:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.622639:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.622645:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.622649:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.622656:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.622672:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:1.0:1787378223.622675:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787378223.622692:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.622698:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d785367c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787378223.625472:0:5793:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787378223.625612:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787378223.625625:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359887904377ns, next at 360887901878ns, rc = 0 00000001:00080000:1.0:1787378223.625634:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787378223.625691:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e100) 00010000:00010000:1.0:1787378223.625695:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787378223.625704:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853667 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7042 expref: 32 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.625847:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863ad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:11359:x1874201604590976:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 13374us (13638us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787378223.625856:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000020:00080000:1.0:1787378223.625862:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787378223.628399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.628488:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604591232 00000100:00100000:2.0:1787378223.628496:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604591232 00000100:00100000:2.0:1787378223.628573:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:2.0:1787378223.628583:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:11359:x1874201604591232:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378223.628616:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.628639:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0600/0xdd3c5462d7853683 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7049 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.628691:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0600/0xdd3c5462d7853683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7049 expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.628705:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0600/0xdd3c5462d7853683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7049 expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.628741:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378223.628744:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378223.628748:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0600, rc 0) 00000100:00100000:2.0:1787378223.628797:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:11359:x1874201604591232:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 216us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.628804:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:0.0:1787378223.631540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378223.631621:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604591488 00000100:00100000:3.0:1787378223.631640:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604591488 00000100:00100000:3.0:1787378223.631694:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1787378223.631703:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:11359:x1874201604591488:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787378223.631941:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:11359:x1874201604591488:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 239us (407us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787378223.631948:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1787378223.642269:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787378223.642291:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626617728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378223.642364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378223.642612:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626617728 00000100:00100000:2.0:1787378223.642620:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626617728 00000100:00100000:2.0:1787378223.642662:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787378223.642670:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9ddc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626617728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787378223.642701:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378223.642754:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9ddc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626617728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.642761:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787378223.643012:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787378223.643022:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626617856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378223.643049:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378223.643180:0:11748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626617856 00000100:00100000:0.0:1787378223.643184:0:11748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626617856 00000100:00100000:0.0:1787378223.643215:0:11748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787378223.643221:0:11748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626617856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378223.643231:0:11748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378223.643260:0:11748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626617856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378223.643265:0:11748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787378223.643440:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626617856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378223.643591:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626617728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378223.716454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.716563:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604591744 00000100:00100000:2.0:1787378223.716575:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604591744 00000100:00100000:2.0:1787378223.716639:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:2.0:1787378223.716663:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+33:11369:x1874201604591744:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378223.716690:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378223.716750:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785368a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7050 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378223.717002:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787378223.717281:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785368a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7050 expref: 35 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.717302:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378223.717305:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378223.717311:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d785368a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7050 expref: 35 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.717326:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0c00, rc 0) 00000100:00100000:2.0:1787378223.717441:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:11369:x1874201604591744:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 779us (996us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787378223.717450:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:3.0:1787378223.730436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378223.730585:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604591872 00000100:00100000:1.0:1787378223.730596:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604591872 00000100:00100000:1.0:1787378223.730659:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:1.0:1787378223.730670:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:11369:x1874201604591872:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1787378223.730781:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.730812:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.730825:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.730840:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.730847:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.730854:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.730944:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.730952:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.730959:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787378223.730998:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731010:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731016:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731033:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731039:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.731044:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731052:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731064:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:1.0:1787378223.731067:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378223.731072:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731093:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731117:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731124:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731130:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731136:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.731139:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731154:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731163:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb85524d00) 00010000:00010000:1.0:1787378223.731165:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378223.731168:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731174:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d785369f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731190:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731195:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731201:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731207:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.731210:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731215:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731225:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378223.731227:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378223.731229:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.731243:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78536a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378223.731311:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:11369:x1874201604591872:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 643us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378223.731319:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:0.0:1787378223.737586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378223.737664:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604592128 00000100:00100000:3.0:1787378223.737673:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604592128 00000100:00100000:3.0:1787378223.737768:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1787378223.737778:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:11369:x1874201604592128:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787378223.738146:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+35:11369:x1874201604592128:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 369us (568us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787378223.738155:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1787378223.778989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378223.779254:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604592384 00000100:00100000:0.0:1787378223.779263:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604592384 00000100:00100000:0.0:1787378223.779330:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:0.0:1787378223.779348:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+35:11372:x1874201604592384:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378223.779373:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378223.779392:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78536ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7057 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779471:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779486:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779497:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779512:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779519:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779526:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779647:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779656:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378223.779664:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378223.779684:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787378223.780978:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.780992:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.780999:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781004:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.781008:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781014:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781028:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:1.0:1787378223.781031:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378223.781035:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781042:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78536b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781055:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781267:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781273:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781278:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378223.781281:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781287:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781295:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdc00) 00010000:00010000:1.0:1787378223.781297:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378223.781300:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781306:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78536bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781421:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78536ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 38 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781436:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 37 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378223.781445:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378223.781447:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787378223.781457:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:1.0:1787378223.781531:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:11372:x1874201604592384:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2184us (2551us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787378223.781540:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:1.0:1787378223.784415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378223.784522:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604592512 00000100:00100000:2.0:1787378223.784532:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604592512 00000100:00100000:2.0:1787378223.784980:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:2.0:1787378223.784992:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:11372:x1874201604592512:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1787378223.785057:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785073:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785111:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785152:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785172:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785180:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785186:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378223.785190:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785197:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785210:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378223.785213:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378223.785217:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378223.785222:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378223.785302:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:11372:x1874201604592512:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 312us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378223.785311:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:0.0:1787378223.788806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378223.790843:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604592768 00000100:00100000:3.0:1787378223.790858:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604592768 00000100:00100000:3.0:1787378223.790924:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:3.0:1787378223.790934:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:11372:x1874201604592768:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787378223.791207:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+38:11372:x1874201604592768:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 273us (2409us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787378223.791227:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1787378224.017834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.017932:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604593024 00000100:00100000:2.0:1787378224.017952:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604593024 00000100:00100000:2.0:1787378224.018013:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00100000:2.0:1787378224.018023:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+38:11403:x1874201604593024:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1787378224.018047:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378224.018066:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a705e expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.018187:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78536de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.018201:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78536de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.018212:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78536de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378224.018222:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787378224.018344:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d78536d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a705e expref: 41 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.018360:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78536de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a705e expref: 40 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.018369:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378224.018372:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378224.018376:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1c00, rc 0) 00000100:00100000:2.0:1787378224.018435:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:11403:x1874201604593024:12345-192.168.203.22@tcp:101:cat.0 Request processed in 414us (611us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787378224.018442:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00100000:2.0:1787378224.021627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378224.021715:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604593280 00000100:00100000:3.0:1787378224.021762:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604593280 00000100:00100000:3.0:1787378224.021808:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1787378224.021818:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:11403:x1874201604593280:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:3.0:1787378224.022054:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+41:11403:x1874201604593280:12345-192.168.203.22@tcp:35:cat.0 Request processed in 236us (435us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787378224.022063:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1787378224.033521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378224.033623:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604593408 00000100:00100000:1.0:1787378224.033633:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604593408 00000100:00100000:1.0:1787378224.033701:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:1.0:1787378224.033711:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+41:2355:x1874201604593408:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378224.033761:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378224.033787:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78536de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a705e expref: 41 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.033805:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378224.033810:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378224.033880:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:2355:x1874201604593408:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 170us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378224.033887:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:1.0:1787378224.067176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378224.067531:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604593664 00000100:00100000:3.0:1787378224.067542:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604593664 00000100:00100000:3.0:1787378224.067603:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:3.0:1787378224.067613:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:11409:x1874201604593664:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:3.0:1787378224.067639:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378224.067642:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787378224.067667:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853644 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7034 expref: 40 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.067687:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:3.0:1787378224.067692:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378224.067705:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78536ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7065 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.067854:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.067868:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.067890:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.067922:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.067935:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 40 pid: 5792 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378224.067948:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626617984:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378224.068031:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378224.069835:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626617984:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378224.069865:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378224.078382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.078553:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604593792 00000100:00100000:2.0:1787378224.078562:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604593792 00010000:00010000:2.0:1787378224.078603:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 41 pid: 5792 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378224.078648:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:2.0:1787378224.078657:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+41:2353:x1874201604593792:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378224.078671:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378224.078678:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 41 pid: 5792 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.078690:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 41 pid: 5792 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.078713:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78536c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7057 expref: 41 pid: 5792 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.078757:0:8358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378224.078778:0:8358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.078787:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.078808:0:8358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.078832:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378224.078879:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:2353:x1874201604593792:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 223us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378224.078886:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00010000:00010000:1.0:1787378224.078946:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.078954:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378224.078972:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787378224.079125:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78536ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 41 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.079178:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 40 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.079185:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378224.079188:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787378224.079190:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05c00, rc 0) 00000100:00100000:1.0:1787378224.079214:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:11409:x1874201604593664:12345-192.168.203.22@tcp:101:dd.0 Request processed in 11603us (12057us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787378224.079221:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:3.0:1787378224.081310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.081488:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604594048 00000100:00100000:2.0:1787378224.081498:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604594048 00000100:00100000:2.0:1787378224.081559:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 155 00000100:00100000:2.0:1787378224.081568:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:11409:x1874201604594048:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:2.0:1787378224.081832:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.081846:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.081856:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378224.081901:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787378224.081925:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089f85c50 reply state 00000000dc87b190 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378224.081934:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378224.084239:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+43:11409:x1874201604594048:12345-192.168.203.22@tcp:36:dd.0 Request processed in 2662us (2927us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787378224.084267:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 155 00000020:00080000:2.0:1787378224.084273:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787378224.089917:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378224.091465:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.091485:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.091492:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.091496:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378224.091501:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.091507:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.091521:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378224.091523:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378224.091540:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.091546:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853701 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378224.338875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.339091:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604594176 00000100:00100000:2.0:1787378224.339103:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604594176 00000100:00100000:2.0:1787378224.339166:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 156 00000100:00100000:2.0:1787378224.339176:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+42:11423:x1874201604594176:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:2.0:1787378224.339203:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378224.339225:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853708 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a706c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339293:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339308:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339320:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339349:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339357:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339365:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339461:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339471:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339496:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339527:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.339540:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 43 pid: 5790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378224.339555:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626618112:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378224.339646:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbac58cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378224.341847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378224.341922:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604594432 00000100:00100000:3.0:1787378224.341931:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604594432 00000100:00100000:3.0:1787378224.341985:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1787378224.341995:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+44:5567:x1874201604594432:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787378224.342319:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:5567:x1874201604594432:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 324us (481us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787378224.342328:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:2.0:1787378224.343528:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626618112:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378224.343557:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378224.344921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378224.345019:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604594560 00000100:00100000:1.0:1787378224.345028:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604594560 00010000:00010000:1.0:1787378224.345067:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 45 pid: 5790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378224.345117:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:1.0:1787378224.345128:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:2353:x1874201604594560:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378224.345144:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378224.345151:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 45 pid: 5790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.345164:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 45 pid: 5790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.345185:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78536f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7065 expref: 45 pid: 5790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.345201:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378224.345206:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.345216:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.345240:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.345271:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378224.345337:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+44:2353:x1874201604594560:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 202us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378224.345345:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00010000:00010000:2.0:1787378224.345492:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345502:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378224.345545:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787378224.345549:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378224.345572:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345585:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345604:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345610:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345616:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345622:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378224.345626:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345633:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345642:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378224.345645:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378224.345649:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345654:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785370f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345665:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345671:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345677:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345689:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378224.345692:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345699:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345707:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeba261e500) 00010000:00010000:2.0:1787378224.345710:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378224.345712:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345786:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345823:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853708 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a706c expref: 44 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345835:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a706c expref: 43 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.345842:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378224.345844:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378224.345847:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1600, rc 0) 00000100:00100000:2.0:1787378224.345896:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+43:11423:x1874201604594176:12345-192.168.203.22@tcp:101:stat.0 Request processed in 6722us (7032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378224.345904:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 156 00000100:00100000:1.0:1787378224.417247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378224.417333:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604594816 00000100:00100000:3.0:1787378224.417353:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604594816 00000100:00100000:3.0:1787378224.417413:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 157 00000100:00100000:3.0:1787378224.417423:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+43:11429:x1874201604594816:12345-192.168.203.22@tcp:36:truncate.0 00010000:00010000:3.0:1787378224.417481:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378224.417518:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785371d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a706c expref: 43 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.417536:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:3.0:1787378224.417542:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378224.418216:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.418234:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.418245:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787378224.418298:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1787378224.418321:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7a97002 reply state 0000000085da5f00 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378224.418342:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787378224.418443:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:11429:x1874201604594816:12345-192.168.203.22@tcp:36:truncate.0 Request processed in 1019us (1205us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787378224.418452:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 157 00000020:00080000:3.0:1787378224.418457:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787378224.422325:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378224.422352:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378224.422360:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378224.422367:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378224.422372:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378224.422380:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378224.422400:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:0.0:1787378224.422404:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378224.422408:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378224.422413:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d7853724 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378224.636205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.637926:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604594944 00000100:00100000:2.0:1787378224.637952:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604594944 00000100:00100000:2.0:1787378224.638149:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:2.0:1787378224.638160:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+44:11443:x1874201604594944:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:2.0:1787378224.638185:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378224.638206:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d785372b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7073 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638273:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638289:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638301:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638315:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638322:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638328:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638433:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638442:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638450:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378224.638491:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787378224.638495:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378224.638513:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638524:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638533:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638539:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638546:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638552:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378224.638556:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638562:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638573:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378224.638576:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378224.638580:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638586:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853732 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638620:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638626:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638632:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638636:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378224.638639:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638646:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638653:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeba261e500) 00010000:00010000:2.0:1787378224.638656:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378224.638659:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638664:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638694:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d785372b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 46 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638707:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 45 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.638769:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378224.638771:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378224.638775:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1600, rc 0) 00000100:00100000:2.0:1787378224.638852:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:11443:x1874201604594944:12345-192.168.203.22@tcp:101:stat.0 Request processed in 693us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378224.638860:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:3.0:1787378224.729794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000040:00080000:0.0:1787378224.730095:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787378224.730100:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787378224.730310:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787378224.730317:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787378224.731101:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604595200 00000100:00100000:2.0:1787378224.731112:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604595200 00000100:00100000:2.0:1787378224.731171:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:2.0:1787378224.731182:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:11453:x1874201604595200:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378224.731204:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378224.731226:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a707a expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378224.731330:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787378224.731439:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853747 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a707a expref: 47 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.731455:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:2.0:1787378224.731458:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378224.731463:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a707a expref: 47 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.731476:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0400, rc 0) 00000100:00100000:2.0:1787378224.731549:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+46:11453:x1874201604595200:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 369us (1763us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787378224.731576:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:0.0:1787378224.734962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378224.735084:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604595456 00000100:00100000:1.0:1787378224.735094:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604595456 00000100:00100000:1.0:1787378224.735158:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1787378224.735167:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+46:11453:x1874201604595456:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378224.735438:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+47:11453:x1874201604595456:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 272us (490us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787378224.735446:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1787378224.797432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.797560:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604595712 00000100:00100000:2.0:1787378224.797570:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604595712 00000100:00100000:2.0:1787378224.797646:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:2.0:1787378224.797657:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+47:11459:x1874201604595712:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787378224.797680:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378224.797698:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853755 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7081 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.797842:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.797858:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 48 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.797867:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.797900:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 48 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.797913:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 48 pid: 5790 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378224.797926:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626618240:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378224.798020:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbac58180 going to sleep for 11 seconds 00000100:00100000:2.0:1787378224.800269:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626618240:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378224.800309:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378224.800912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.800983:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604595840 00000100:00100000:2.0:1787378224.800989:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604595840 00010000:00010000:2.0:1787378224.801020:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 49 pid: 5790 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378224.801057:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1787378224.801065:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+49:2354:x1874201604595840:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378224.801088:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378224.801094:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 49 pid: 5790 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.801106:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 49 pid: 5790 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.801127:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853740 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7073 expref: 49 pid: 5790 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.801142:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378224.801147:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.801156:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.801173:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.801208:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378224.801340:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.801348:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378224.801366:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787378224.801511:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853755 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.801528:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 49 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.801536:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:3.0:1787378224.801539:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787378224.801541:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1800, rc 0) 00000100:00100000:2.0:1787378224.801581:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+49:2354:x1874201604595840:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 515us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378224.801598:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:3.0:1787378224.806874:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+48:11459:x1874201604595712:12345-192.168.203.22@tcp:101:bash.0 Request processed in 9064us (9294us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787378224.806888:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:0.0:1787378224.811046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.813419:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604596096 00000100:00100000:2.0:1787378224.813434:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604596096 00000100:00100000:2.0:1787378224.813551:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 161 00000100:00100000:2.0:1787378224.813562:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+48:11459:x1874201604596096:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1787378224.813839:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.813869:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.813882:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378224.813932:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787378224.813958:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0587bf6 reply state 000000005b537088 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378224.813966:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378224.814589:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+51:11459:x1874201604596096:12345-192.168.203.22@tcp:36:bash.0 Request processed in 1026us (3549us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787378224.814599:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 161 00000020:00080000:2.0:1787378224.814605:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787378224.818962:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.818980:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.818988:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.818994:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378224.819011:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.819019:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.819035:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378224.819039:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378224.819043:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.819050:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d785376a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378224.821321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.821531:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604596224 00000100:00100000:2.0:1787378224.821540:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604596224 00000100:00100000:2.0:1787378224.821589:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:2.0:1787378224.821608:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+50:11459:x1874201604596224:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787378224.821633:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378224.821653:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853771 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7088 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.821766:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.821780:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.821789:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.821820:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.821832:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 51 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378224.821845:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626618368:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378224.822015:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf717480 going to sleep for 11 seconds 00000100:00100000:0.0:1787378224.827660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378224.828016:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626618368:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378224.828043:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378224.828178:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604596352 00000100:00100000:1.0:1787378224.828186:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604596352 00010000:00010000:1.0:1787378224.828221:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 52 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378224.828249:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1787378224.828259:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:2354:x1874201604596352:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378224.828272:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378224.828278:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 52 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.828288:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 52 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.828308:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785375c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7081 expref: 52 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.828353:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378224.828358:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.828366:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.828374:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.828400:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378224.828455:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+51:2354:x1874201604596352:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 197us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378224.828464:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00010000:00010000:2.0:1787378224.828810:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.828828:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378224.828872:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787378224.828877:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378224.828896:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.828924:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d7853771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7088 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.828938:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7088 expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378224.828946:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378224.828949:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378224.828952:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0c00, rc 0) 00000100:00100000:2.0:1787378224.828990:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+50:11459:x1874201604596224:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7383us (7678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378224.829001:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:0.0:1787378224.833764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378224.833859:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604596608 00000100:00100000:1.0:1787378224.833869:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604596608 00000100:00100000:1.0:1787378224.833925:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:1.0:1787378224.833934:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+50:11459:x1874201604596608:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:1.0:1787378224.834168:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+51:11459:x1874201604596608:12345-192.168.203.22@tcp:35:bash.0 Request processed in 233us (453us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787378224.834176:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:1.0:1787378224.920347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378224.920431:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604596864 00000100:00100000:3.0:1787378224.920440:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604596864 00000100:00100000:3.0:1787378224.920499:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:3.0:1787378224.920509:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+51:11469:x1874201604596864:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378224.920532:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378224.920551:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d785377f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a708f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378224.920650:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787378224.920791:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d785377f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a708f expref: 53 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.920806:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:3.0:1787378224.920808:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787378224.920813:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d785377f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a708f expref: 53 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.920845:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05000, rc 0) 00000100:00100000:3.0:1787378224.920894:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:11469:x1874201604596864:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 386us (565us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787378224.920902:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:0.0:1787378224.923615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378224.923673:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604596992 00000100:00100000:3.0:1787378224.923681:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604596992 00000100:00100000:3.0:1787378224.923744:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:3.0:1787378224.923752:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:11469:x1874201604596992:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1787378224.923812:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.923825:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.923836:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.923851:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.923868:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.923874:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.923957:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.923982:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.923989:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787378224.924023:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924034:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924041:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924049:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924054:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378224.924058:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924065:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924086:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:3.0:1787378224.924088:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378224.924092:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924098:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d785378d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924115:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924121:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924127:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924132:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378224.924134:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924140:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924147:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb916d9400) 00010000:00010000:3.0:1787378224.924149:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378224.924151:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924156:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924176:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924182:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924187:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924198:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378224.924201:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924207:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924215:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:3.0:1787378224.924218:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378224.924220:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.924225:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785379b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378224.924292:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:11469:x1874201604596992:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 540us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378224.924300:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:0.0:1787378224.926700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378224.926983:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604597248 00000100:00100000:1.0:1787378224.926993:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604597248 00000100:00100000:1.0:1787378224.927048:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1787378224.927058:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:11469:x1874201604597248:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378224.927541:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:11469:x1874201604597248:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 483us (850us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787378224.927549:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1787378224.956538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378224.956624:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604597504 00000100:00100000:3.0:1787378224.956635:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604597504 00000100:00100000:3.0:1787378224.956793:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:3.0:1787378224.956803:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:11472:x1874201604597504:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378224.956827:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378224.956844:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78537a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7096 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.956913:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.956945:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.956956:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.956972:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.956979:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.956986:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957119:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78537b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957128:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78537b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957140:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78537b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378224.957149:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787378224.957341:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957349:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957354:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957366:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378224.957371:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957379:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957391:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:3.0:1787378224.957394:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378224.957399:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957405:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d78537a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957418:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957424:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957430:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957435:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378224.957438:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957444:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957462:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb916d9400) 00010000:00010000:3.0:1787378224.957465:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378224.957468:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957473:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78537b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957513:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78537a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7096 expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957526:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78537b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7096 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.957533:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:3.0:1787378224.957536:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378224.957539:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05000, rc 0) 00000100:00100000:3.0:1787378224.957606:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:11472:x1874201604597504:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 804us (1077us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1787378224.957614:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:0.0:1787378224.961172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378224.961213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378224.961275:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604597760 00000100:00100000:1.0:1787378224.961284:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604597760 00000100:00100000:1.0:1787378224.961470:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1787378224.961480:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:2354:x1874201604597760:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378224.961495:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378224.961518:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d78537b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7096 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378224.961537:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:1.0:1787378224.961542:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378224.961559:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604597632 00000100:00100000:3.0:1787378224.961564:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604597632 00000100:00100000:1.0:1787378224.961591:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:2354:x1874201604597760:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 112us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378224.961597:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1787378224.961600:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:3.0:1787378224.961606:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:11472:x1874201604597632:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:3.0:1787378224.961667:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961682:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961704:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961756:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961763:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961769:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961774:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378224.961779:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961786:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961795:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:3.0:1787378224.961801:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787378224.961805:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378224.961811:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378224.961844:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:11472:x1874201604597632:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 237us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378224.961851:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:0.0:1787378224.963996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378224.964040:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604598016 00000100:00100000:1.0:1787378224.964048:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604598016 00000100:00100000:1.0:1787378224.964106:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1787378224.964114:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+54:11472:x1874201604598016:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378224.964331:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:11472:x1874201604598016:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 216us (426us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787378224.964339:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1787378225.095596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378225.095749:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604598272 00000100:00100000:2.0:1787378225.095759:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604598272 00000100:00080000:3.0:1787378225.095941:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378225.096033:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:2.0:1787378225.096044:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:11490:x1874201604598272:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1787378225.096190:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378225.096213:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78537cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a709d expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.096321:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.096461:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.096474:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378225.096487:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787378225.096622:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78537cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a709d expref: 58 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.096643:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a709d expref: 57 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.096652:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378225.096655:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787378225.096659:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0000, rc 0) 00000100:00100000:2.0:1787378225.096922:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:11490:x1874201604598272:12345-192.168.203.22@tcp:101:cat.0 Request processed in 879us (1334us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787378225.096930:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 167 00010000:00010000:2.0:1787378225.113974:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378225.139441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.139547:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604598400 00000100:00100000:3.0:1787378225.139558:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604598400 00000100:00100000:3.0:1787378225.139618:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:3.0:1787378225.139628:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:11491:x1874201604598400:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378225.139651:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378225.139670:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70a4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.139765:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78537e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.139778:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78537e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.139789:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78537e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378225.139905:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787378225.139909:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378225.139930:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78537e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.139956:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70a4 expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.139974:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78537e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70a4 expref: 58 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.139983:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:3.0:1787378225.139986:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378225.140003:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04000, rc 0) 00000100:00100000:3.0:1787378225.140055:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11491:x1874201604598400:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 428us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378225.143954:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:0.0:1787378225.146355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.146421:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604598784 00000100:00100000:3.0:1787378225.146429:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604598784 00000100:00100000:3.0:1787378225.146478:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:3.0:1787378225.146487:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11491:x1874201604598784:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787378225.146784:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11491:x1874201604598784:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 297us (439us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787378225.146792:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:1.0:1787378225.157206:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378225.157478:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604598912 00000100:00100000:2.0:1787378225.157488:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604598912 00000100:00100000:2.0:1787378225.157549:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:2.0:1787378225.157558:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8a3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11491:x1874201604598912:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:2.0:1787378225.157581:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787378225.157607:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7088 expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.157629:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a709d expref: 58 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.157641:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0600/0xdd3c5462d7853683 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7049 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.157650:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378225.157660:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378225.157716:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8a3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:11491:x1874201604598912:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 158us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378225.157773:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1787378225.160201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.160288:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604599040 00000100:00100000:3.0:1787378225.160297:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604599040 00000100:00100000:3.0:1787378225.160360:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:3.0:1787378225.160370:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:11491:x1874201604599040:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:3.0:1787378225.160471:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.160487:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.160498:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787378225.160675:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787378225.161444:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:11491:x1874201604599040:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 1073us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378225.161452:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:0.0:1787378225.187715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378225.187887:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604599168 00000100:00100000:2.0:1787378225.187896:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604599168 00000100:00100000:2.0:1787378225.187955:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:2.0:1787378225.187965:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:11493:x1874201604599168:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378225.187987:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378225.188009:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0600/0xdd3c5462d78537f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70ab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188083:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188097:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188121:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188138:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188145:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188152:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188264:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188273:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188280:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378225.188315:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787378225.188319:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378225.188336:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188347:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188355:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188371:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188378:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188384:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378225.188388:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188395:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188407:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378225.188410:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378225.188414:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188422:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d78537fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188436:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188442:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188448:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188453:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378225.188460:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188466:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188705:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeba261e200) 00010000:00010000:2.0:1787378225.188708:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378225.188712:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188786:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188825:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0600/0xdd3c5462d78537f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188836:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.188843:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb916d9400) 00010000:00010000:2.0:1787378225.188846:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378225.188848:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0200, rc 0) 00000100:00100000:2.0:1787378225.188917:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:11493:x1874201604599168:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 954us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378225.188925:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 170 00000040:00080000:2.0:1787378225.761004:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787378225.761011:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787378225.761085:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787378225.761092:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787378225.761279:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626618496:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787378225.761485:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbac589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378225.763786:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626618496:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787378225.765832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.766596:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604599296 00000100:00100000:3.0:1787378225.766607:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604599296 00000100:00100000:3.0:1787378225.766663:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:3.0:1787378225.766673:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:11505:x1874201604599296:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787378225.766705:0:9982:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787378225.767162:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:11505:x1874201604599296:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 488us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378225.767170:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:0.0:1787378225.771889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.775998:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604599424 00000100:00100000:1.0:1787378225.776015:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604599424 00000100:00100000:1.0:1787378225.776091:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:1.0:1787378225.776102:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:11505:x1874201604599424:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787378225.776684:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.776703:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.776807:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.776827:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.776836:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.776845:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.776945:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.776955:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.776962:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378225.776999:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787378225.777017:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378225.777032:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777044:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777050:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777057:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777073:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378225.777077:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777085:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777096:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:1.0:1787378225.777100:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378225.777104:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777110:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853812 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777124:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777129:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777273:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777278:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378225.777281:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777288:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777296:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9eeb85524d00) 00010000:00010000:1.0:1787378225.777298:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378225.777301:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777306:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853819 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777320:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777326:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777332:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777337:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378225.777340:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777354:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777362:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb916d9400) 00010000:00010000:1.0:1787378225.777364:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378225.777367:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.777373:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853820 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378225.777610:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:11505:x1874201604599424:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 1452us (5671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378225.777620:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:0.0:1787378225.781388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.781483:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604599680 00000100:00100000:1.0:1787378225.781493:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604599680 00000100:00100000:1.0:1787378225.781554:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:1.0:1787378225.781563:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:11505:x1874201604599680:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378225.781584:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378225.781604:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853827 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70b2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781703:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781753:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781766:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378225.781790:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787378225.781882:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781890:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781896:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781903:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378225.781907:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781915:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781927:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb916d9400) 00010000:00010000:1.0:1787378225.781930:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787378225.781935:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781941:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d785382e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781982:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853827 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70b2 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.781991:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:1.0:1787378225.781994:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787378225.782003:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d7853827 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70b2 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.782013:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547e00, rc 0) 00000100:00100000:1.0:1787378225.782058:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11505:x1874201604599680:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 496us (679us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787378225.782078:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:1.0:1787378225.798256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.798309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.798409:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.798450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.798497:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604600192 00000100:00100000:1.0:1787378225.798510:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604600192 00000100:00100000:1.0:1787378225.798598:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:1.0:1787378225.798614:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604600192:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378225.798624:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604599936 00000100:00100000:0.0:1787378225.798640:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604599936 00000100:00100000:0.0:1787378225.798711:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604600064 00000100:00100000:0.0:1787378225.798715:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604600064 00000100:00100000:3.0:1787378225.798985:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:3.0:1787378225.798999:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604599936:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378225.799052:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604599936:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 57us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378225.799072:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:2.0:1787378225.799142:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604599808 00000100:00100000:2.0:1787378225.799149:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604599808 00000100:00100000:0.0:1787378225.799187:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:2.0:1787378225.799204:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:0.0:1787378225.799205:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604600064:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378225.799225:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604599808:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378225.799266:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2356:x1874201604599808:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 48us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378225.799274:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:0.0:1787378225.799306:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2356:x1874201604600064:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 105us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378225.799316:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:1.0:1787378225.799363:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2355:x1874201604600192:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 752us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378225.799373:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00080000:1.0:1787378225.799403:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378225.799408:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787378225.799412:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378225.804025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378225.804654:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604600320 00000100:00100000:0.0:1787378225.804668:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604600320 00000100:00100000:0.0:1787378225.804762:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:0.0:1787378225.804775:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11505:x1874201604600320:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787378225.805244:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787378225.806612:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11505:x1874201604600320:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 1833us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378225.806623:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:1.0:1787378225.818677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.819297:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604600576 00000100:00100000:3.0:1787378225.819326:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604600576 00000100:00100000:3.0:1787378225.819413:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:3.0:1787378225.819426:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11505:x1874201604600576:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787378225.819455:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378225.819459:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787378225.819496:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78537e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70a4 expref: 58 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.819520:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:3.0:1787378225.819526:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378225.819561:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d785383c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70b9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787378225.821266:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787378225.821478:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.821496:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.821507:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.821586:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05000/0xdd3c5462d785383c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70b9 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.821606:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70b9 expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.821615:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378225.821618:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378225.821621:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1400, rc 0) 00000100:00100000:2.0:1787378225.823028:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11505:x1874201604600576:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 3598us (4363us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787378225.823040:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:3.0:1787378225.830038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378225.830116:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604600832 00000100:00100000:2.0:1787378225.830130:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604600832 00000100:00100000:2.0:1787378225.830197:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:2.0:1787378225.830206:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11505:x1874201604600832:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787378225.830260:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378225.830286:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70b9 expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830304:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeba261e200) 00010000:00010000:2.0:1787378225.830326:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378225.830353:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830366:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830375:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830388:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830396:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830402:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830486:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830493:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830501:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830507:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378225.830511:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830519:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830527:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378225.830530:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378225.830534:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830540:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d7853851 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830549:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830555:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830560:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830583:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378225.830586:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830592:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830600:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6389e980 (ffff9eeba261e500) 00010000:00010000:2.0:1787378225.830602:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378225.830605:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.830610:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0e00/0xdd3c5462d7853858 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6389e980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378225.830697:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11505:x1874201604600832:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 491us (674us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787378225.830704:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:2.0:1787378225.834214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.834440:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604600960 00000100:00100000:3.0:1787378225.834457:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604600960 00000100:00100000:3.0:1787378225.834540:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:3.0:1787378225.834553:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11505:x1874201604600960:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787378225.834584:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378225.834616:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785385f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70c0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.834669:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.834686:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.834700:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.834879:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d785385f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.834900:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.834910:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:3.0:1787378225.834913:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787378225.834926:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05800, rc 0) 00000100:00100000:3.0:1787378225.835134:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11505:x1874201604600960:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 580us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378225.835143:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:3.0:1787378225.837187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378225.837288:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604601216 00000100:00100000:2.0:1787378225.837307:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604601216 00000100:00100000:2.0:1787378225.837435:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:2.0:1787378225.837447:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11505:x1874201604601216:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787378225.837563:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.837579:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.837609:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787378225.838117:0:9982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787378225.838134:0:9982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362100413464ns, next at 363100409062ns, rc = 0 00000004:00010000:2.0:1787378225.838257:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ef9a940 reply state 000000000c843caa transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378225.838269:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378225.838392:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11505:x1874201604601216:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 946us (1217us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787378225.838401:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 178 00010000:00010000:0.0:1787378225.840438:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.840457:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.840465:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.840472:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378225.840478:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.840487:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.840506:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:0.0:1787378225.840523:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787378225.840531:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.840537:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d785386d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378225.840758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378225.841184:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604601344 00000100:00100000:2.0:1787378225.841198:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604601344 00000100:00100000:2.0:1787378225.841284:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:2.0:1787378225.841295:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:11505:x1874201604601344:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378225.841331:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378225.841350:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70c7 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.841412:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.841423:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.841439:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:2.0:1787378225.841449:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378225.841451:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1a00, rc 0) 00000100:00100000:2.0:1787378225.841520:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11505:x1874201604601344:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 228us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378225.841525:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:2.0:1787378225.845815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.846249:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604601472 00000100:00100000:3.0:1787378225.846264:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604601472 00000100:00100000:3.0:1787378225.846352:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:3.0:1787378225.846365:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2354:x1874201604601472:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787378225.848883:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604601472:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 2504us (3065us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787378225.848976:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1787378225.852901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.853002:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604601728 00000100:00100000:3.0:1787378225.853016:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604601728 00000100:00100000:3.0:1787378225.853103:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787378225.853123:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11505:x1874201604601728:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787378225.853435:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11505:x1874201604601728:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 313us (548us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787378225.853444:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787378225.855642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.855795:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604601984 00000100:00100000:1.0:1787378225.855811:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604601984 00000100:00100000:1.0:1787378225.855879:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:1.0:1787378225.855890:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11505:x1874201604601984:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787378225.856019:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11505:x1874201604601984:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 130us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378225.856027:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:3.0:1787378225.860959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.861059:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604602112 00000100:00100000:1.0:1787378225.861082:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604602112 00000100:00100000:1.0:1787378225.861165:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:1.0:1787378225.861177:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11505:x1874201604602112:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378225.861204:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378225.861231:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785387b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70ce expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.861392:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.861411:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.861425:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378225.861477:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378225.861500:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.861535:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d785387b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ce expref: 64 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.861557:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ce expref: 63 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.861580:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:1.0:1787378225.861583:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787378225.861589:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547c00, rc 0) 00000100:00100000:1.0:1787378225.861692:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:11505:x1874201604602112:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 516us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378225.861701:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:3.0:1787378225.872080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.872133:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604602240 00000100:00100000:3.0:1787378225.872145:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604602240 00000100:00100000:3.0:1787378225.872209:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787378225.872221:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604602240:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787378225.872247:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378225.872273:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70d5 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787378225.872331:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a893a31, blocks: 0x1 00010000:00010000:3.0:1787378225.872360:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1787378225.872366:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378225.872378:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.872400:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378225.872416:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04000, rc 0) 00000100:00100000:3.0:1787378225.872485:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604602240:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 266us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378225.872494:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787378225.875674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378225.875746:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604602496 00000100:00100000:3.0:1787378225.875758:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604602496 00000100:00100000:3.0:1787378225.875825:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:3.0:1787378225.875836:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:11505:x1874201604602496:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787378225.875984:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:11505:x1874201604602496:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 148us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378225.875994:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:3.0:1787378225.881269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378225.881365:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604602624 00000100:00100000:0.0:1787378225.881378:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604602624 00000100:00100000:0.0:1787378225.881452:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:0.0:1787378225.881464:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:11505:x1874201604602624:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378225.881487:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378225.881511:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70dc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.881553:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 9 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.881564:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378225.881569:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378225.881576:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 9 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.881624:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 9 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378225.881642:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 9 pid: 6586 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378225.881675:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626618624:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378225.881820:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb92f64f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378225.896521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378225.896563:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604602752 00000100:00100000:1.0:1787378225.896574:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604602752 00010000:00010000:1.0:1787378225.896629:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 10 pid: 6586 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378225.896679:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:1.0:1787378225.896691:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:2353:x1874201604602752:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378225.896710:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378225.896775:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 10 pid: 6586 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.896793:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 10 pid: 6586 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.896828:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378225.896834:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378225.896845:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 10 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.897001:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 10 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378225.897052:0:6603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 10 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378225.897080:0:6603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae705f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6603:1874201626618752:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787378225.898015:0:6603:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c59780 going to sleep for 11 seconds 00010000:00010000:2.0:1787378225.898204:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853889 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70d5 expref: 10 pid: 6586 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378225.898226:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874201626618624:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378225.898259:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 9 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378225.898275:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128aa00, rc 0) 00000100:00100000:2.0:1787378225.898330:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:11505:x1874201604602624:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 16857us (17064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378225.898340:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:1.0:1787378225.903871:0:6603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae705f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6603:1874201626618752:192.168.203.22@tcp:105: 00010000:00010000:1.0:1787378225.903912:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378225.903988:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604602752:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 7297us (7475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378225.904001:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1787378225.909550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378225.909706:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604602880 00000100:00100000:0.0:1787378225.909746:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604602880 00002000:00100000:0.0:1787378225.910036:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9eebae6fad80 x1874201604602880/t0(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:296/0 lens 504/0 e 0 to 0 dl 1787378236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378225.910049:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebae6fad80 with x1874201604602880 ext(0->8) 00002000:00010000:0.0:1787378225.910056:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eebae6fad80 00000100:00100000:0.0:1787378225.910107:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1787378225.910117:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604602880:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787378225.911620:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:2354:x1874201604602880:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 1492us (2075us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787378225.911634:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00002000:00100000:0.0:1787378225.911646:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9eebae6fad80 x1874201604602880/t4294967314(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:296/0 lens 504/448 e 0 to 0 dl 1787378236 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378225.911656:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebae6fad80 with x1874201604602880 ext(0->8) 00002000:00010000:0.0:1787378225.911663:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eebae6fad80 00000100:00100000:3.0:1787378225.915979:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378225.916162:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604603008 00000100:00100000:0.0:1787378225.916176:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604603008 00000100:00100000:0.0:1787378225.916251:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:0.0:1787378225.916262:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:11505:x1874201604603008:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000040:00080000:3.0:1787378226.006692:0:12305:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378226.006707:0:12305:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378226.006796:0:12305:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787378226.006802:0:12305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787378226.012557:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000001:00080000:2.0:1787378226.012573:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:2.0:1787378226.012590:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787378226.012611:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eeb9a207c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787378226.012615:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb9e13f500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb9a207600 00000020:00080000:2.0:1787378226.012631:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb9e13fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eebbf5fac00 00000001:00080000:2.0:1787378226.012664:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1787378226.012669:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1787378226.012703:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1787378226.013157:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787378226.013369:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787378226.013438:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626618880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787378226.013507:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378226.013563:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378226.013569:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626619008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787378226.013598:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378226.013633:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626618880 00000100:00100000:2.0:1787378226.013640:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626618880 00000100:00100000:2.0:1787378226.013692:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626619008 00000100:00100000:2.0:1787378226.013696:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626619008 00000100:00100000:2.0:1787378226.014242:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787378226.014256:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626618880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787378226.014289:0:6586:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1787378226.014326:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a893a2f, atime: 0x6a893a2f, ctime: 0x6a893a2f, blocks: 0x1 00010000:00010000:2.0:1787378226.014335:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.014352:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1787378226.014357:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378226.014364:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.014399:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.014410:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.014419:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.014499:0:6586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787378226.015283:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626618880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1030us (1774us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787378226.015293:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787378226.015319:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787378226.015329:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626619008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787378226.016161:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787378226.016167:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787378225 00002000:00010000:2.0:1787378226.016170:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787378226.016172:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787378225 -> 1787378225 00002000:00010000:2.0:1787378226.016174:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787378226.016213:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626619008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 887us (2615us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787378226.016220:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787378226.016252:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378226.016257:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787378226.016290:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787378226.016297:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.016308:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378226.016313:0:6602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.016324:0:6602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.016343:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.016350:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7853897 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.016370:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378226.016374:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378226.016377:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787378226.016418:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eebb53efb80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787378226.016425:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626619008:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1787378226.016453:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eeb867da300/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787378226.016460:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626618880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787378226.016471:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11505:x1874201604603008:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 100196us (100493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378226.016488:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:3.0:1787378226.020813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378226.021519:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604603136 00000100:00100000:0.0:1787378226.021548:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604603136 00000100:00100000:0.0:1787378226.021624:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1787378226.021637:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:2353:x1874201604603136:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787378226.109494:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1787378226.109601:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1787378226.110560:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604603136:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 88911us (89746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378226.110580:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1787378226.121470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378226.124622:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604603392 00000100:00100000:2.0:1787378226.124650:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604603392 00000100:00100000:2.0:1787378226.124793:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:2.0:1787378226.124876:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11505:x1874201604603392:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787378226.124951:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378226.124990:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ce expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.125011:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:2.0:1787378226.125017:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378226.125059:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.125087:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.125099:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378226.125554:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064939305 reply state 00000000b1d89d99 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378226.125567:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378226.125702:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:11505:x1874201604603392:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 899us (4246us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787378226.125712:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:1.0:1787378226.130117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:2.0:1787378226.132939:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.132966:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.132989:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.132997:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378226.133003:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.133012:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.133034:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:2.0:1787378226.133038:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378226.133043:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.133050:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785389e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378226.133108:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604603520 00000100:00100000:2.0:1787378226.133123:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604603520 00000100:00100000:2.0:1787378226.133209:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1787378226.133221:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604603520:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787378226.133566:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787378226.133570:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787378225 -> 1787378224 00002000:00010000:2.0:1787378226.133573:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787378223 00002000:00010000:2.0:1787378226.133576:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787378225 -> 1787378224 00002000:00010000:2.0:1787378226.133578:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787378226.133671:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604603520:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 450us (3568us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787378226.133687:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00010000:00010000:0.0:1787378226.138995:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378226.140331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378226.140659:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604603776 00000100:00100000:1.0:1787378226.140674:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604603776 00000100:00100000:1.0:1787378226.140823:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:1.0:1787378226.140838:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11505:x1874201604603776:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787378226.140962:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.140986:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.140997:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.141049:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.141082:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 18 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378226.141101:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae704000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626619136:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378226.141225:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bf600 going to sleep for 11 seconds 00000100:00100000:2.0:1787378226.148494:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae704000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626619136:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378226.148540:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378226.152513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378226.152626:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604603904 00000100:00100000:1.0:1787378226.152640:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604603904 00010000:00010000:1.0:1787378226.153697:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 19 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378226.153775:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:1.0:1787378226.153793:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:2353:x1874201604603904:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378226.153820:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378226.153829:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 19 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.153871:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 19 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.153900:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05800/0xdd3c5462d7853866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c0 expref: 19 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.153922:0:8358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:1.0:1787378226.153928:0:8358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.153939:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.153948:0:8358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378226.153979:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378226.154123:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.154133:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.154168:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.154177:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.154184:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.154191:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378226.154196:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.154205:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.154215:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:0.0:1787378226.154217:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787378226.154230:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.154236:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d78538a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378226.157794:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:2353:x1874201604603904:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1458us (2745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378226.157825:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:0.0:1787378226.158467:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:11505:x1874201604603776:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 17629us (18146us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787378226.158482:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:1.0:1787378226.166269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378226.166338:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604604032 00000100:00100000:2.0:1787378226.166353:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604604032 00000100:00100000:2.0:1787378226.166428:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:2.0:1787378226.166440:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2356:x1874201604604032:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787378226.166500:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.166527:0:8120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.166539:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378226.166544:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787378226.166550:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.166608:0:8120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.166625:0:8120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 8 pid: 6588 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378226.166663:0:8120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb901f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8120:1874201626619264:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378226.166823:0:8120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787378226.171958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378226.172143:0:8120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb901f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8120:1874201626619264:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378226.172182:0:8120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378226.172334:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604604160 00000100:00100000:0.0:1787378226.172344:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604604160 00010000:00010000:0.0:1787378226.172399:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 9 pid: 6588 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378226.172452:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:0.0:1787378226.172473:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2353:x1874201604604160:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378226.172493:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378226.172523:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 9 pid: 6588 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.172538:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 9 pid: 6588 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.172571:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec4a134c/0xdd3c5462d7853890 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70dc expref: 9 pid: 6588 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.172592:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787378226.172598:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787378226.172641:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.172654:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.172680:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378226.172765:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604604160:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 293us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378226.172773:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00010000:00010000:3.0:1787378226.172893:0:8120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.172904:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.172934:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.172944:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.172953:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.172959:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378226.172964:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.172980:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.173049:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.173057:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008004fabe/0xdd3c5462d78538ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378226.173134:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2356:x1874201604604032:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 6696us (6892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378226.173143:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:2.0:1787378226.181874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378226.181948:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604604416 00000100:00100000:3.0:1787378226.181961:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604604416 00000100:00100000:3.0:1787378226.182040:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:3.0:1787378226.182051:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+17:11505:x1874201604604416:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787378226.182182:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.182205:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.182221:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.182493:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.182516:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.182526:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.182568:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.182583:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 18 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378226.182599:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626619392:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378226.182702:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683480 going to sleep for 11 seconds 00000100:00100000:3.0:1787378226.186426:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626619392:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378226.186480:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378226.187512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378226.188092:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604604544 00000100:00100000:0.0:1787378226.188104:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604604544 00010000:00010000:0.0:1787378226.188175:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 19 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378226.188226:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:0.0:1787378226.188238:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:2353:x1874201604604544:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378226.188256:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378226.188264:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 19 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.188279:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 19 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.188308:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1a00/0xdd3c5462d7853874 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70c7 expref: 19 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.188324:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:0.0:1787378226.188337:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.188350:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.188358:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.188391:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378226.188434:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.188446:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378226.188468:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:2353:x1874201604604544:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 230us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378226.188479:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000001:00080000:3.0:1787378226.188753:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787378226.189436:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787378226.189516:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787378226.189630:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626619520:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787378226.189712:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378226.189765:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207000 going to sleep for 11 seconds 00000100:00100000:0.0:1787378226.191272:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626619520 00000100:00100000:0.0:1787378226.191285:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626619520 00000100:00100000:0.0:1787378226.191361:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787378226.191371:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9982:x1874201626619520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787378226.191515:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9982:x1874201626619520:12345-0@lo:1000:mdt00_003.0 Request processed in 145us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378226.191523:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787378226.191752:0:9982:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787378226.191760:0:9982:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eebb53efb80, transno 4294967315 00000100:00100000:1.0:1787378226.191777:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626619520:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787378226.192423:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787378226.192528:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae704380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626619648:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787378226.192590:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378226.192637:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787378226.192670:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626619648 00000100:00100000:3.0:1787378226.192677:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626619648 00000100:00100000:3.0:1787378226.192746:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787378226.192755:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9982:x1874201626619648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787378226.193379:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9982:x1874201626619648:12345-0@lo:1000:mdt00_003.0 Request processed in 623us (785us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787378226.193387:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378226.195360:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae704380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626619648:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787378226.195431:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195445:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195454:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195460:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378226.195466:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195475:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195496:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9c00) 00010000:00010000:2.0:1787378226.195500:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378226.195506:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195512:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78538ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195563:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195569:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195576:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195581:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378226.195584:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195591:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195600:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb916d9400) 00010000:00010000:2.0:1787378226.195602:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378226.195605:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195611:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d78537ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195639:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195657:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195668:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195745:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378226.195765:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 21 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378226.195784:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626619776:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378226.197457:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787378226.202409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378226.202429:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626619776:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378226.202474:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378226.202771:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604604672 00000100:00100000:3.0:1787378226.202780:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604604672 00010000:00010000:3.0:1787378226.202826:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 22 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378226.202925:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:3.0:1787378226.202936:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:2354:x1874201604604672:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378226.202954:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378226.202962:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 22 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.202976:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 22 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.203002:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d785380b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ab expref: 22 pid: 5790 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.203020:0:8358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb916d9400) 00010000:00010000:3.0:1787378226.203038:0:8358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.203050:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.203070:0:8358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.203097:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378226.203167:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:2354:x1874201604604672:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 231us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378226.203175:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00010000:00010000:0.0:1787378226.204262:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.204277:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.204295:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.204302:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.204322:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.204329:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378226.204334:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.204343:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.204357:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb916d9400) 00010000:00010000:0.0:1787378226.204361:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378226.204365:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.204372:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78538c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.206275:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.206288:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.206295:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.206301:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378226.206305:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.206328:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.206347:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb916d9400) 00010000:00010000:0.0:1787378226.206350:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787378226.206355:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.206362:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05400/0xdd3c5462d78538b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378226.209899:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:11505:x1874201604604416:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 26742us (26934us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787378226.209923:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 186 00000020:00080000:0.0:1787378226.209932:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787378226.210077:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787378226.210084:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787378226.211152:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787378226.211169:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787378226.224469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378226.224656:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604604928 00000100:00100000:3.0:1787378226.224672:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604604928 00000100:00100000:3.0:1787378226.224769:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:3.0:1787378226.224782:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:11505:x1874201604604928:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787378226.225818:0:5793:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787378226.226118:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787378226.226185:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.226207:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.226222:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.226231:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.226251:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.226258:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378226.226331:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787378226.226457:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:11505:x1874201604604928:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1674us (1995us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787378226.226468:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000020:00080000:3.0:1787378226.226475:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787378226.233798:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378226.233816:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.233829:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378226.233835:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.233915:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.233941:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eeb916d9800) 00010000:00010000:0.0:1787378226.233944:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787378226.233962:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.233969:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05c00/0xdd3c5462d78538c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378226.233993:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378226.233995:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378226.233997:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787378226.249134:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1787378226.249151:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787378226.249162:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00010000:00010000:2.0:1787378227.162454:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787378227.762046:0:12359:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787378227.763628:0:12359:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787378227.763697:0:12359:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787378227.763703:0:12359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787378227.905627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378227.905703:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604605184 00000100:00100000:1.0:1787378227.905714:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604605184 00000100:00080000:3.0:1787378227.905909:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378227.906768:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:1.0:1787378227.906780:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:11523:x1874201604605184:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378227.906803:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378227.906824:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78538cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70e3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.907091:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78538d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.907105:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78538d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.907117:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78538d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378227.907129:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787378227.907305:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d78538cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70e3 expref: 25 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.907336:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78538d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70e3 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.907343:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:1.0:1787378227.907346:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787378227.907349:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547e00, rc 0) 00000100:00100000:1.0:1787378227.907415:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:11523:x1874201604605184:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 637us (1795us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787378227.907423:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:3.0:1787378227.910462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378227.910537:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604605312 00000100:00100000:0.0:1787378227.910547:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604605312 00000100:00100000:0.0:1787378227.910603:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:0.0:1787378227.910612:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:11523:x1874201604605312:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1787378227.910681:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.910697:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.910709:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.910762:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.910770:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.910794:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911088:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911097:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911105:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378227.911142:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911154:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911160:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911167:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911173:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378227.911177:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911185:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911197:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378227.911206:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378227.911212:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911218:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78538e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911229:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911235:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911241:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911247:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378227.911250:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911256:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911263:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378227.911265:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378227.911268:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911273:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78538eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911288:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911301:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911306:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911312:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378227.911315:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911321:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911329:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378227.911332:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378227.911335:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.911341:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378227.911416:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:11523:x1874201604605312:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 804us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378227.911423:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:3.0:1787378227.960851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378227.961079:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604605568 00000100:00100000:0.0:1787378227.961090:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604605568 00000100:00100000:0.0:1787378227.961152:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:0.0:1787378227.961163:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:11526:x1874201604605568:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378227.961185:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378227.961220:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70ea expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961292:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961305:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961316:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961330:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961338:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961344:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961652:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961661:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961668:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378227.961677:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787378227.961806:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961823:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961829:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961835:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378227.961839:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961846:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961858:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378227.961861:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378227.961865:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961871:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853900 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961884:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961890:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961907:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961912:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378227.961922:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961929:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.961946:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378227.961949:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378227.961952:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.962228:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.962273:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78538f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.962286:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.962294:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378227.962296:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378227.962299:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b600, rc 0) 00000100:00100000:0.0:1787378227.962358:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:11526:x1874201604605568:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1197us (1516us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787378227.962366:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:0.0:1787378227.966704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378227.966888:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604605696 00000100:00100000:1.0:1787378227.966905:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604605696 00000100:00100000:0.0:1787378227.967017:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:0.0:1787378227.967035:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:11526:x1874201604605696:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787378227.967121:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967136:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967146:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967170:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967177:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967184:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967190:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378227.967194:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967201:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967211:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378227.967214:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378227.967218:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378227.967224:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d785391c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378227.967303:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:11526:x1874201604605696:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 270us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378227.967311:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:1.0:1787378227.969417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378227.969581:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604605952 00000100:00100000:0.0:1787378227.969590:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604605952 00000100:00100000:0.0:1787378227.969686:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:0.0:1787378227.969698:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:11526:x1874201604605952:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787378227.969928:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:11526:x1874201604605952:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 231us (516us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787378227.969957:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787378227.996964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378227.997062:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604606208 00000100:00100000:1.0:1787378227.997071:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604606208 00000100:00100000:1.0:1787378227.997131:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:1.0:1787378227.997141:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:11051:x1874201604606208:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787378227.997436:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378227.997459:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7853923 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70f1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.997557:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.997572:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.997582:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.997627:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378227.997640:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 28 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378227.997654:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae704000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626619904:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378227.997795:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb87461f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787378228.001585:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae704000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626619904:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378228.001617:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378228.001869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.002014:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604606336 00000100:00100000:0.0:1787378228.002021:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604606336 00010000:00010000:0.0:1787378228.002063:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 29 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.002098:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:0.0:1787378228.002107:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:2354:x1874201604606336:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378228.002121:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378228.002128:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 29 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.002157:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 29 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.002179:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785390e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ea expref: 29 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.002194:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378228.002199:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.002209:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.002216:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.002243:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378228.002297:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:2354:x1874201604606336:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 191us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.002305:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00010000:00010000:1.0:1787378228.002486:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.002495:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378228.002511:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787378228.002653:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7853923 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.002669:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.002677:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:1.0:1787378228.002680:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787378228.002683:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547c00, rc 0) 00000100:00100000:1.0:1787378228.002767:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:11051:x1874201604606208:12345-192.168.203.22@tcp:101:bash.0 Request processed in 5580us (5764us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787378228.002774:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:3.0:1787378228.005361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.005485:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604606592 00000100:00100000:0.0:1787378228.005495:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604606592 00000100:00100000:0.0:1787378228.005553:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:0.0:1787378228.005563:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:11051:x1874201604606592:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:0.0:1787378228.005847:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.005864:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.005885:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787378228.006029:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787378228.006068:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099cfa398 reply state 000000003669092f transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.006077:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787378228.006129:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787378228.006228:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:11051:x1874201604606592:12345-192.168.203.22@tcp:36:bash.0 Request processed in 666us (877us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787378228.006237:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 192 00000020:00080000:0.0:1787378228.006241:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787378228.008279:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.008294:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.008301:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.008315:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378228.008332:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.008341:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.008357:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:3.0:1787378228.008361:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378228.008365:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.008372:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853938 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.008666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.009006:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604606720 00000100:00100000:2.0:1787378228.009015:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604606720 00000100:00100000:2.0:1787378228.009079:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:2.0:1787378228.009089:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:11051:x1874201604606720:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787378228.009112:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378228.009129:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d785393f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70f8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.009184:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d785393f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f8 expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.009199:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d785393f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f8 expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.009219:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:2.0:1787378228.009222:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378228.009225:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0800, rc 0) 00000100:00100000:2.0:1787378228.009291:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:11051:x1874201604606720:12345-192.168.203.22@tcp:101:bash.0 Request processed in 202us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.009298:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:0.0:1787378228.011698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.011895:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604606848 00000100:00100000:2.0:1787378228.011904:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604606848 00000100:00100000:2.0:1787378228.012037:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:2.0:1787378228.012055:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:11051:x1874201604606848:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787378228.012071:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378228.012094:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a70ff expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787378228.012119:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a893a30, atime: 0x6a893a2f, ctime: 0x6a893a30, blocks: 0xb 00010000:00010000:2.0:1787378228.012140:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787378228.012146:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378228.012155:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.012172:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.012184:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0e00, rc 0) 00000100:00100000:2.0:1787378228.012246:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:11051:x1874201604606848:12345-192.168.203.22@tcp:101:bash.0 Request processed in 201us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.012253:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00080000:3.0:1787378228.014428:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787378228.015790:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.015942:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604606976 00000100:00100000:0.0:1787378228.015952:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604606976 00002000:00010000:0.0:1787378228.015987:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787378228.015992:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb901f9c00 with x1874201604606976 ext(0->18446744073709551615) 00002000:00010000:0.0:1787378228.016003:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eeb901f9c00. 00000100:00100000:0.0:1787378228.016038:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1787378228.016058:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604606976:12345-192.168.203.22@tcp:10:bash.0 00002000:00010000:0.0:1787378228.016517:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787378228.016522:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787378224 -> 1787378227 00002000:00010000:0.0:1787378228.016524:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787378223 -> 1787378223 00002000:00010000:0.0:1787378228.016526:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787378224 -> 1787378227 00002000:00010000:0.0:1787378228.016528:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787378228.016939:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2353:x1874201604606976:12345-192.168.203.22@tcp:10:bash.0 Request processed in 881us (1145us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787378228.016949:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00002000:00010000:0.0:1787378228.016953:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787378228.016955:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eeb901f9c00 with x1874201604606976 ext(0->18446744073709551615) 00002000:00010000:0.0:1787378228.016961:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eeb901f9c00. 00000100:00100000:1.0:1787378228.080673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.080872:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604607104 00000100:00100000:0.0:1787378228.080882:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604607104 00000100:00100000:0.0:1787378228.080944:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:0.0:1787378228.080955:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:11540:x1874201604607104:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1787378228.081030:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081055:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081068:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081083:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081091:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081098:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081624:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081647:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081655:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378228.081697:0:9982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081708:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081715:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081818:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081825:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.081829:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081847:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081860:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378228.081863:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.081868:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081874:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d785394d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081894:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081901:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081907:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081912:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.081916:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081922:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081931:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378228.081933:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.081937:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081943:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081959:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081965:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081971:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081982:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.081985:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.081992:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.082000:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378228.082003:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.082005:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.082011:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785395b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.082151:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:11540:x1874201604607104:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1195us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.082219:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:1.0:1787378228.110598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.110716:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604607360 00000100:00100000:2.0:1787378228.110749:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604607360 00000100:00100000:2.0:1787378228.110857:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:2.0:1787378228.110869:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+32:11543:x1874201604607360:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378228.110891:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378228.110912:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853962 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7106 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.110981:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.110995:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111005:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111019:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111026:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111032:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111560:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111571:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111579:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378228.111601:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787378228.111689:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111697:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111704:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111709:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378228.111714:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111748:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111760:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378228.111763:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378228.111768:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111775:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7853969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111788:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111794:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111811:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111817:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378228.111820:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.111825:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.112016:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeba261e600) 00010000:00010000:2.0:1787378228.112020:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378228.112023:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.112030:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7853970 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.112084:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7106 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.112098:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7106 expref: 34 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.112105:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:2.0:1787378228.112108:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787378228.112111:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0000, rc 0) 00000100:00100000:2.0:1787378228.112704:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:11543:x1874201604607360:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1834us (2111us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787378228.112759:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:2.0:1787378228.115419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.115526:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604607488 00000100:00100000:1.0:1787378228.115536:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604607488 00000100:00100000:1.0:1787378228.115636:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:1.0:1787378228.115647:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+34:11543:x1874201604607488:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:1.0:1787378228.115708:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.115794:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 34 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.115806:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.115849:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 34 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.115864:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 34 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.115879:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae989f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626620032:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378228.116019:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb87461f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378228.118812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.118887:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604607744 00000100:00100000:3.0:1787378228.118896:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604607744 00000100:00100000:3.0:1787378228.118952:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1787378228.118961:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+35:5567:x1874201604607744:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000001:00080000:3.0:1787378228.119217:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1787378228.119319:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:5567:x1874201604607744:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 358us (515us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787378228.119329:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000020:00080000:3.0:1787378228.119334:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787378228.121748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.121827:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604607872 00000100:00100000:1.0:1787378228.121846:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604607872 00010000:00010000:1.0:1787378228.121885:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 37 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.121942:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:1.0:1787378228.121951:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8a3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:2354:x1874201604607872:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378228.121964:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378228.121971:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 37 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.121984:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 37 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.122006:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:1.0:1787378228.122011:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.122021:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.122028:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.122045:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378228.122106:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8a3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:2354:x1874201604607872:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 156us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378228.122114:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00010000:00010000:0.0:1787378228.125628:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d785392a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f1 expref: 36 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.125656:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae989f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626620032:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378228.125681:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125691:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125697:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125763:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125771:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125778:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125784:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.125788:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125795:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125809:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378228.125812:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378228.125817:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.125823:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853985 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.126005:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+35:11543:x1874201604607488:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 10358us (10592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.126016:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:2.0:1787378228.128546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.128663:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604608128 00000100:00100000:3.0:1787378228.128673:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604608128 00000100:00100000:3.0:1787378228.128785:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1787378228.128796:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+35:11543:x1874201604608128:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787378228.129027:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:11543:x1874201604608128:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 232us (488us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787378228.129057:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00010000:00010000:2.0:1787378228.186121:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378228.196537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.196694:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604608384 00000100:00100000:0.0:1787378228.196704:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604608384 00000100:00100000:0.0:1787378228.196802:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:0.0:1787378228.196827:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+36:11554:x1874201604608384:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1787378228.196863:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.196884:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785398c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a710d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.196954:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.196968:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.196980:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.196996:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197004:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197011:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197453:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197464:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197471:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378228.197491:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787378228.197589:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197598:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197604:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197610:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.197614:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197621:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197633:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378228.197976:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.197983:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.197991:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853993 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198005:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198011:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198027:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198033:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.198036:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198043:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198061:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdc00) 00010000:00010000:0.0:1787378228.198064:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.198067:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198072:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d785399a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198116:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d785398c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a710d expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198130:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a710d expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.198138:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378228.198141:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378228.198143:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a600, rc 0) 00000100:00100000:0.0:1787378228.198479:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+38:11554:x1874201604608384:12345-192.168.203.22@tcp:101:cat.0 Request processed in 1652us (1950us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787378228.198495:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:2.0:1787378228.203946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.204055:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604608640 00000100:00100000:1.0:1787378228.204066:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604608640 00000100:00100000:1.0:1787378228.204155:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:1.0:1787378228.204188:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+38:11554:x1874201604608640:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:1.0:1787378228.204470:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+39:11554:x1874201604608640:12345-192.168.203.22@tcp:35:cat.0 Request processed in 284us (533us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787378228.204478:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1787378228.219455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.219574:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604608896 00000100:00100000:0.0:1787378228.219585:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604608896 00000100:00100000:0.0:1787378228.219657:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:0.0:1787378228.219668:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+39:11555:x1874201604608896:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:0.0:1787378228.219760:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787378228.219786:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a710d expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.219807:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0000/0xdd3c5462d7853977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7106 expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.219817:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0800/0xdd3c5462d785393f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70f8 expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.219826:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378228.219837:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378228.219857:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.219869:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.219879:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.219892:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.219917:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.219925:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.220234:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.220244:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.220251:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787378228.220891:0:9982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787378228.220902:0:9982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364483181664ns, next at 365483179189ns, rc = 0 00010000:00010000:0.0:1787378228.220959:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.220969:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.220977:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.220985:0:9982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.220991:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221008:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221036:0:9982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378228.221069:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221076:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221082:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221088:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.221093:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221100:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.221111:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378228.221113:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cd900) 00010000:00010000:0.0:1787378228.221118:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787378228.221121:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221123:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.221141:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378228.221141:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.221147:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.221158:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221161:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221171:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.221172:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eeb829cd900) 00010000:00010000:3.0:1787378228.221176:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787378228.221182:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221189:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.221193:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78539c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221200:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.221205:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221213:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.221216:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378228.221219:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378228.221223:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378228.221226:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378228.221230:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.221234:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.221240:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539af lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378228.221251:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001daafd35 reply state 00000000805d3f8a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.221259:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787378228.221343:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+38:11555:x1874201604608896:12345-192.168.203.22@tcp:36:rm.0 Request processed in 1674us (1895us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787378228.221352:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 198 00010000:00010000:1.0:1787378228.223862:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.223877:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.223884:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.223890:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378228.223894:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.223901:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.223915:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdc00) 00010000:00010000:1.0:1787378228.223918:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378228.223922:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.223927:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d78539b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378228.250209:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626620416:0@lo:400:kworker.0 00000100:00100000:2.0:1787378228.250279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378228.250352:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378228.250358:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626620544:0@lo:400:kworker.0 00000100:00100000:2.0:1787378228.250385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378228.250700:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626620416 00000100:00100000:0.0:1787378228.250708:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626620416 00000100:00100000:0.0:1787378228.250791:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787378228.250801:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626620416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378228.250867:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626620416:12345-0@lo:400:kworker.0 Request processed in 67us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.250873:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787378228.250975:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626620416:0@lo:400:kworker.0 00000100:00080000:2.0:1787378228.250998:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378228.251864:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626620160:0@lo:400:kworker.0 00000100:00100000:3.0:1787378228.251909:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378228.251950:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626620672:0@lo:400:kworker.0 00000100:00100000:3.0:1787378228.251972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378228.252001:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787378228.252009:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626620288:0@lo:400:kworker.0 00000100:00100000:1.0:1787378228.252044:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626620544 00000100:00100000:3.0:1787378228.252059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378228.252062:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626620544 00000100:00100000:3.0:1787378228.252080:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626620800:0@lo:400:kworker.0 00000100:00100000:3.0:1787378228.252109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378228.252164:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626620672 00000100:00100000:0.0:1787378228.252169:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626620672 00000100:00100000:2.0:1787378228.252194:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626620160 00000100:00100000:2.0:1787378228.252199:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626620160 00000100:00100000:0.0:1787378228.252201:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626620288 00000100:00100000:0.0:1787378228.252205:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626620288 00000100:00100000:0.0:1787378228.252232:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787378228.252240:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787378228.252242:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626620672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378228.252253:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626620160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378228.252300:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874201626620672:12345-0@lo:400:kworker.0 Request processed in 60us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.252307:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3311:x1874201626620160:12345-0@lo:400:kworker.0 Request processed in 57us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.252308:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787378228.252319:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787378228.252328:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787378228.252336:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626620288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378228.252367:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626620288:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.252373:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1787378228.252412:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787378228.252415:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378228.258214:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626620800 00000100:00100000:1.0:1787378228.258231:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626620800 00000100:00100000:3.0:1787378228.259174:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787378228.259195:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626620544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378228.259294:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626620544:12345-0@lo:400:kworker.0 Request processed in 109us (8907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378228.259301:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787378228.259355:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626620288:0@lo:400:kworker.0 00000100:00100000:3.0:1787378228.259367:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3311:1874201626620160:0@lo:400:kworker.0 00000100:00100000:3.0:1787378228.259378:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626620672:0@lo:400:kworker.0 00000100:00100000:1.0:1787378228.259487:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787378228.259493:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787378228.259509:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eeb867da300, transno 4294967307 00000100:00100000:1.0:1787378228.259526:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626620544:0@lo:400:kworker.0 00000100:00100000:0.0:1787378228.263269:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787378228.263284:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626620800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378228.263371:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874201626620800:12345-0@lo:400:kworker.0 Request processed in 91us (11262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.263378:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787378228.263538:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626620800:0@lo:400:kworker.0 00000100:00080000:1.0:1787378228.263561:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787378228.281036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.281099:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604609152 00000100:00100000:0.0:1787378228.281108:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604609152 00000100:00100000:0.0:1787378228.281174:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:0.0:1787378228.281197:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+37:11561:x1874201604609152:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378228.281224:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.281245:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7114 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.281382:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.281397:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.281409:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.281424:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.281432:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.281439:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787378228.282178:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787378228.282340:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282351:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282360:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282405:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282413:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282419:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282425:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.282429:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282437:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282449:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378228.282452:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.282457:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282463:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d78539d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378228.282475:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be3c356f reply state 000000005d809593 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.282484:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787378228.282516:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78539cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282543:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 39 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.282551:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378228.282554:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378228.282557:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128be00, rc 0) 00000100:00100000:0.0:1787378228.282927:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:11561:x1874201604609152:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1731us (1899us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787378228.282947:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 199 00010000:00010000:3.0:1787378228.293525:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.293543:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.293551:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.293557:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378228.293562:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.293569:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.293600:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdb00) 00010000:00010000:3.0:1787378228.293603:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378228.293608:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.293614:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78539d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378228.296238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.296322:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604609280 00000100:00100000:3.0:1787378228.296332:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604609280 00000100:00100000:3.0:1787378228.296405:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1787378228.296414:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604609280:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787378228.296431:0:8120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378228.296451:0:8120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a711b expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787378228.296477:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378228.296494:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1787378228.296499:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378228.296509:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 6 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.296526:0:8120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 6 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.296539:0:8120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04400, rc 0) 00000100:00100000:3.0:1787378228.296598:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604609280:12345-192.168.203.22@tcp:101:bash.0 Request processed in 185us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378228.296616:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00080000:1.0:1787378228.296685:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378228.300549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.300703:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604609408 00000100:00100000:3.0:1787378228.300713:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604609408 00000100:00100000:3.0:1787378228.300796:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:3.0:1787378228.300806:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:11561:x1874201604609408:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787378228.300823:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378228.300855:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7122 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.300887:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 7 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.300896:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378228.300901:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378228.300906:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.300942:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 7 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.300954:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 7 pid: 8120 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378228.300969:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6588:1874201626620928:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378228.301061:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787378228.305119:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6588:1874201626620928:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378228.305155:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.305176:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04600, rc 0) 00000100:00100000:3.0:1787378228.305346:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:11561:x1874201604609408:12345-192.168.203.22@tcp:101:bash.0 Request processed in 4540us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378228.305355:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1787378228.312787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.313213:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604609536 00000100:00100000:1.0:1787378228.313223:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604609536 00010000:00010000:1.0:1787378228.313263:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 7 pid: 8120 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.313324:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:1.0:1787378228.313334:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604609536:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378228.313348:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378228.313370:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 7 pid: 8120 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.313384:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 7 pid: 8120 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.313407:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcbaa182/0xdd3c5462d78539ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a711b expref: 7 pid: 8120 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.313423:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378228.313428:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378228.313450:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.313461:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.313499:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.313513:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae989500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5777:1874201626621056:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787378228.313606:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729240 going to sleep for 11 seconds 00000100:00100000:1.0:1787378228.317153:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae989500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5777:1874201626621056:192.168.203.22@tcp:105: 00010000:00010000:1.0:1787378228.317181:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378228.317239:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604609536:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 3905us (4461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378228.317249:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:0.0:1787378228.321584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.321688:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604609792 00000100:00100000:3.0:1787378228.321697:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604609792 00000100:00100000:2.0:1787378228.322196:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1787378228.322209:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+39:11561:x1874201604609792:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1787378228.322571:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:11561:x1874201604609792:12345-192.168.203.22@tcp:35:bash.0 Request processed in 365us (998us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787378228.322580:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1787378228.442243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.442436:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604609920 00000100:00100000:2.0:1787378228.442444:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604609920 00000100:00100000:2.0:1787378228.442530:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:2.0:1787378228.442541:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+40:11577:x1874201604609920:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378228.442567:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378228.442588:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78539fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7129 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.442650:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.442663:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.442673:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378228.442788:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787378228.442792:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378228.442816:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.442841:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0200/0xdd3c5462d78539fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7129 expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.442860:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7129 expref: 41 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.442884:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378228.442887:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787378228.442891:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1600, rc 0) 00000100:00100000:2.0:1787378228.442944:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+41:11577:x1874201604609920:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 405us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.442951:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:3.0:1787378228.445626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.445863:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604610176 00000100:00100000:0.0:1787378228.445872:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604610176 00000100:00100000:0.0:1787378228.445956:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:0.0:1787378228.445965:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+41:11577:x1874201604610176:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378228.445985:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.446005:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853a0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7130 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.446104:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853a11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.446118:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.446128:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378228.446150:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787378228.446273:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853a0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7130 expref: 44 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.446290:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7130 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.446298:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378228.446312:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378228.446316:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b600, rc 0) 00000100:00100000:0.0:1787378228.446370:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+43:11577:x1874201604610176:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 406us (752us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787378228.446377:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:1.0:1787378228.449382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.449459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.449525:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604610560 00000100:00100000:0.0:1787378228.449535:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604610560 00000100:00100000:0.0:1787378228.449593:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:0.0:1787378228.449603:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+43:11577:x1874201604610560:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378228.449628:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.449648:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7137 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.449760:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.449775:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.449803:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378228.449817:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787378228.449938:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7137 expref: 46 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.449956:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7137 expref: 45 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.449964:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378228.449967:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787378228.449970:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a600, rc 0) 00000100:00100000:0.0:1787378228.450082:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:11577:x1874201604610560:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 480us (621us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787378228.450090:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:3.0:1787378228.450223:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604610304 00000100:00100000:3.0:1787378228.450228:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604610304 00000100:00100000:3.0:1787378228.450268:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1787378228.450276:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+45:2355:x1874201604610304:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378228.450285:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378228.450299:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853a11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7130 expref: 45 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.450310:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:3.0:1787378228.450313:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378228.450333:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+44:2355:x1874201604610304:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 59us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378228.450340:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1787378228.454434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.454525:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604610688 00000100:00100000:3.0:1787378228.454535:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604610688 00000100:00100000:3.0:1787378228.454632:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:3.0:1787378228.454653:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+6:2353:x1874201604610688:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:3.0:1787378228.454697:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.454716:0:8120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.454756:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378228.454761:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378228.454765:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.454797:0:8120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.454811:0:8120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 6 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378228.454825:0:8120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8120:1874201626621184:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378228.455015:0:8120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787378228.456633:0:8120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8120:1874201626621184:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378228.456657:0:8120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.459586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.460040:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604610816 00000100:00100000:0.0:1787378228.460059:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604610816 00002000:00100000:0.0:1787378228.460104:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9eebae989880 x1874201604610816/t0(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:299/0 lens 504/0 e 0 to 0 dl 1787378239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378228.460115:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebae989880 with x1874201604610816 ext(0->8) 00010000:00010000:0.0:1787378228.460123:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 7 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.460138:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 7 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378228.460177:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9eebae989880 00000100:00100000:0.0:1787378228.460211:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1787378228.460220:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604610816:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:0.0:1787378228.460691:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2353:x1874201604610816:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 470us (1114us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787378228.460700:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00002000:00100000:0.0:1787378228.460706:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9eebae989880 x1874201604610816/t4294967308(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:299/0 lens 504/448 e 0 to 0 dl 1787378239 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378228.460714:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebae989880 with x1874201604610816 ext(0->8) 00010000:00010000:0.0:1787378228.460753:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 9 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.460765:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 9 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378228.460772:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9eebae989880 00000100:00100000:1.0:1787378228.463137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.463319:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604610944 00000100:00100000:3.0:1787378228.463329:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604610944 00010000:00010000:3.0:1787378228.463379:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 9 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378228.463419:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:3.0:1787378228.463427:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2355:x1874201604610944:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378228.463444:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787378228.463461:0:8358:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787378228.463464:0:8358:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787378228 00002000:00010000:3.0:1787378228.463466:0:8358:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787378228 00002000:00010000:3.0:1787378228.463469:0:8358:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787378228 00010000:00010000:3.0:1787378228.463475:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 9 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.463490:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 9 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.463512:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78539f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7122 expref: 9 pid: 6588 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.463529:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378228.463533:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378228.463539:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.463548:0:8358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.463597:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378228.463653:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2355:x1874201604610944:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 226us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378228.463660:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00010000:00010000:1.0:1787378228.464629:0:8120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.464645:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.464689:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.464697:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.464705:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.464712:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378228.464716:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.464763:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.464779:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.464786:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a221d76d/0xdd3c5462d7853a34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.465028:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604610688:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 10373us (10600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378228.465037:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1787378228.468213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.468298:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604611200 00000100:00100000:0.0:1787378228.468316:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604611200 00000100:00100000:0.0:1787378228.468370:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:0.0:1787378228.468379:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+44:11577:x1874201604611200:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:0.0:1787378228.468434:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7137 expref: 44 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787378228.468688:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787378228.468779:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787378228.469086:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1787378228.469154:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.469169:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.469178:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.469212:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.469228:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 48 pid: 5792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.469242:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874201626621312:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378228.469325:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378228.471953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.472064:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874201626621312:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378228.472092:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.472183:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604611328 00000100:00100000:1.0:1787378228.472190:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604611328 00010000:00010000:1.0:1787378228.472227:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 49 pid: 5792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.472264:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:1.0:1787378228.472274:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+49:2354:x1874201604611328:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378228.472288:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378228.472295:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 49 pid: 5792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.472306:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 49 pid: 5792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.472329:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78539e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7114 expref: 49 pid: 5792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.472345:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:1.0:1787378228.472350:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.472360:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.472367:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.472386:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378228.472452:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+48:2354:x1874201604611328:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 179us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378228.472460:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00010000:00010000:0.0:1787378228.472515:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.472522:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787378228.472642:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1787378228.472862:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787378228.472964:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae93dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874201626621440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787378228.473009:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378228.473041:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378228.473173:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626621440 00000100:00100000:3.0:1787378228.473178:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626621440 00000100:00100000:3.0:1787378228.473220:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787378228.473227:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1874201626621440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787378228.473309:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1874201626621440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378228.473316:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787378228.473452:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae93dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874201626621440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787378228.473910:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1787378228.473974:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84558a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874201626621568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787378228.474017:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378228.474053:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8ce4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787378228.474072:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626621568 00000100:00100000:3.0:1787378228.474076:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626621568 00000100:00100000:3.0:1787378228.474097:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787378228.474103:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1874201626621568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787378228.474248:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1874201626621568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (230us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787378228.474255:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787378228.475416:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84558a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874201626621568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787378228.475482:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787378228.475530:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.475540:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.475548:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.475554:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.475559:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.475567:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.475581:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378228.475584:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787378228.475598:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.475606:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a3b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787378228.475807:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787378228.475891:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1787378228.475901:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364738181247ns, next at 365738179336ns, rc = 0 00000001:00080000:0.0:1787378228.475907:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1787378228.475937:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378228.475940:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787378228.475947:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7137 expref: 52 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.476040:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+51:11577:x1874201604611200:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 7662us (7836us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787378228.476060:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000020:00080000:0.0:1787378228.476064:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787378228.478281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.478358:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604611456 00000100:00100000:0.0:1787378228.478367:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604611456 00000100:00100000:0.0:1787378228.478422:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:0.0:1787378228.478431:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+51:11577:x1874201604611456:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378228.478453:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.478472:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853a42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a713e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.478527:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853a42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a713e expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.478555:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853a42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a713e expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.478575:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378228.478578:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787378228.478581:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:0.0:1787378228.478637:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:11577:x1874201604611456:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 207us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.478642:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:1.0:1787378228.481627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.481712:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604611712 00000100:00100000:2.0:1787378228.481753:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604611712 00000100:00100000:2.0:1787378228.481799:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:2.0:1787378228.481807:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+52:11577:x1874201604611712:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787378228.482027:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:11577:x1874201604611712:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 219us (408us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787378228.482035:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1787378228.566785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.567154:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604611840 00000100:00100000:0.0:1787378228.567170:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604611840 00000100:00100000:0.0:1787378228.567234:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:0.0:1787378228.567244:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:11587:x1874201604611840:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1787378228.567329:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567348:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567360:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567375:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567391:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567417:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567514:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567523:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567531:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378228.567572:0:9982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567584:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567591:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567597:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567603:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.567607:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567613:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567641:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378228.567650:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.567655:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567663:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567678:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567685:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567692:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567698:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.567701:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567708:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567777:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378228.567781:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.567785:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567792:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567808:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567822:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567838:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567844:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.567848:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567855:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567863:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378228.567866:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.567869:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.567875:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.567942:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:11587:x1874201604611840:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 698us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.567952:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:1.0:1787378228.630950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.631056:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604612096 00000100:00100000:0.0:1787378228.631066:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604612096 00000100:00100000:0.0:1787378228.631122:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:0.0:1787378228.631131:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+53:11590:x1874201604612096:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378228.631151:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.631185:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7145 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631253:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631267:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631279:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631294:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631302:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631309:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631443:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631452:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631460:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378228.631469:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787378228.631554:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631573:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631579:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631586:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.631591:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631599:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631611:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378228.631614:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.631618:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631637:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631651:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631658:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631664:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631670:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378228.631678:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631685:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631693:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378228.631696:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378228.631700:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631706:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631791:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631805:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.631813:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378228.631816:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378228.631818:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128be00, rc 0) 00000100:00100000:0.0:1787378228.631886:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:11590:x1874201604612096:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 755us (945us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787378228.631894:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:1.0:1787378228.634944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.635052:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604612224 00000100:00100000:2.0:1787378228.635061:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604612224 00000100:00100000:2.0:1787378228.635143:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:2.0:1787378228.635153:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:11590:x1874201604612224:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1787378228.635216:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635231:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635241:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635278:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635283:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635290:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635295:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378228.635300:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635307:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635319:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:2.0:1787378228.635322:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378228.635326:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.635333:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0400/0xdd3c5462d7853a81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378228.635405:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:11590:x1874201604612224:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 252us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.635411:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:2.0:1787378228.642787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.642993:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604612480 00000100:00100000:1.0:1787378228.643003:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604612480 00000100:00100000:1.0:1787378228.643067:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1787378228.643077:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+55:11590:x1874201604612480:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787378228.643311:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:11590:x1874201604612480:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 234us (531us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787378228.643318:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1787378228.715390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.715603:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604612736 00000100:00100000:0.0:1787378228.715613:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604612736 00000100:00100000:0.0:1787378228.715712:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:0.0:1787378228.715745:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb901f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:11600:x1874201604612736:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378228.715778:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.715782:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787378228.715807:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7853a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7129 expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.715825:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378228.715838:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378228.715852:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a714c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.715945:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.715959:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.715966:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.715996:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.716008:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 56 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.716019:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb84559880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626621696:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378228.716124:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8ce4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787378228.721428:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb84559880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874201626621696:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378228.721477:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.724521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.734003:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604612864 00000100:00100000:0.0:1787378228.734020:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604612864 00010000:00010000:0.0:1787378228.734072:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 57 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.734181:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1787378228.734192:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+57:2354:x1874201604612864:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378228.734206:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378228.734215:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 57 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.734230:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 57 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.734253:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7145 expref: 57 pid: 5790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.734268:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378228.734274:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.734283:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.734766:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.734818:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378228.734874:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:2354:x1874201604612864:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 682us (10360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.734883:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00010000:00010000:1.0:1787378228.739404:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.739421:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378228.739444:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787378228.739607:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853a88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.739628:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.739653:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378228.739656:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787378228.739659:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a600, rc 0) 00000100:00100000:1.0:1787378228.739765:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb901f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:11600:x1874201604612736:12345-192.168.203.22@tcp:101:bash.0 Request processed in 24043us (24383us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1787378228.739773:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:1.0:1787378228.748114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.748254:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604613120 00000100:00100000:0.0:1787378228.748264:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604613120 00000100:00100000:0.0:1787378228.748313:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:0.0:1787378228.748322:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+56:11600:x1874201604613120:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:0.0:1787378228.748617:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.748633:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.748661:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787378228.748715:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1787378228.748781:0:9982:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003535eaa1 reply state 00000000ae110fa7 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.748790:0:9982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787378228.748983:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11600:x1874201604613120:12345-192.168.203.22@tcp:36:bash.0 Request processed in 655us (880us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787378228.748991:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 208 00000020:00080000:1.0:1787378228.749000:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787378228.759276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:1.0:1787378228.759378:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.759391:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.759398:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.759404:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378228.759409:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.759416:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.759433:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378228.759449:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378228.759455:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.759461:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853a9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.759666:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604613248 00000100:00100000:0.0:1787378228.759676:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604613248 00000100:00100000:0.0:1787378228.759769:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:0.0:1787378228.759780:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11600:x1874201604613248:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378228.759804:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.759820:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853aa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7153 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.759914:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.762445:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.762463:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378228.762464:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787378228.762486:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626621824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378228.762548:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378228.762584:0:11748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626621824 00000100:00100000:0.0:1787378228.762593:0:11748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626621824 00000100:00100000:0.0:1787378228.762646:0:11748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787378228.762654:0:11748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874201626621824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378228.762675:0:11748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378228.762738:0:11748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874201626621824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.762746:0:11748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787378228.764022:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626621824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787378228.764513:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.764548:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 59 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378228.764563:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626621952:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378228.764707:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787378228.766142:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378228.766161:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626622080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378228.766214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378228.766254:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626622080 00000100:00100000:2.0:1787378228.766262:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626622080 00000100:00100000:2.0:1787378228.766302:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787378228.766312:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626622080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787378228.766347:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378228.772557:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626622080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6237us (6333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.772571:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787378228.772828:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626622080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378228.773237:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626621952:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378228.773258:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378228.778965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378228.779150:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604613376 00000100:00100000:0.0:1787378228.779160:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604613376 00010000:00010000:0.0:1787378228.779201:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 60 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378228.779243:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:0.0:1787378228.779252:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:2354:x1874201604613376:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378228.779268:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378228.779275:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 60 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.779300:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 60 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.779322:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853a8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a714c expref: 60 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.779337:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378228.779342:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.779362:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.779370:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.779399:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378228.779450:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:2354:x1874201604613376:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 199us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.779459:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00010000:00010000:1.0:1787378228.779794:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.779802:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378228.779846:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787378228.779850:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378228.779869:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.779899:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853aa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.779914:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.779921:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378228.779924:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787378228.779926:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b600, rc 0) 00000100:00100000:1.0:1787378228.779961:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11600:x1874201604613248:12345-192.168.203.22@tcp:101:bash.0 Request processed in 20184us (20694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378228.779968:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1787378228.791640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.791770:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604613632 00000100:00100000:1.0:1787378228.791780:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604613632 00000100:00100000:1.0:1787378228.791937:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:1.0:1787378228.791951:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+58:11600:x1874201604613632:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:1.0:1787378228.792201:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11600:x1874201604613632:12345-192.168.203.22@tcp:35:bash.0 Request processed in 252us (569us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787378228.795028:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1787378228.870207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.871117:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604613760 00000100:00100000:2.0:1787378228.871129:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604613760 00000100:00100000:0.0:1787378228.871653:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:0.0:1787378228.871666:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+59:11606:x1874201604613760:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378228.871689:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378228.871710:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a715a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.871849:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853ab9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.871877:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.871888:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378228.872198:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787378228.872203:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787378228.872229:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.872256:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d7853ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a715a expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.872273:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a715a expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378228.872282:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378228.872285:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787378228.872288:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128be00, rc 0) 00000100:00100000:0.0:1787378228.872357:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:11606:x1874201604613760:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 693us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378228.872365:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:2.0:1787378228.875087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.875203:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604613888 00000100:00100000:1.0:1787378228.875212:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604613888 00000100:00100000:1.0:1787378228.875309:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:1.0:1787378228.875319:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:11606:x1874201604613888:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378228.875349:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378228.875370:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7853ac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7161 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875441:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875456:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875466:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875480:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875500:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875506:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875599:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875613:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875621:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378228.875655:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787378228.875671:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378228.875687:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875698:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875706:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875712:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875748:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875767:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378228.875779:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875788:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875800:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:1.0:1787378228.875803:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378228.875807:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875813:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546200/0xdd3c5462d7853ac7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875827:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875834:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875840:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875845:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378228.875848:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875854:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875872:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb85524d00) 00010000:00010000:1.0:1787378228.875875:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378228.875878:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875884:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547400/0xdd3c5462d7853ace lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875913:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81546000/0xdd3c5462d7853ac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875927:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.875934:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378228.875937:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787378228.875939:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81547c00, rc 0) 00000100:00100000:1.0:1787378228.875989:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11606:x1874201604613888:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 671us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378228.875997:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:3.0:1787378228.881079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.881129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.881199:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604614144 00000100:00100000:1.0:1787378228.881209:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604614144 00000100:00100000:1.0:1787378228.881271:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:1.0:1787378228.881281:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11606:x1874201604614144:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378228.881308:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378228.881359:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853adc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7168 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.881492:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.881508:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 62 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.881515:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.881522:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.881554:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.881567:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 62 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.881580:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626622208:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378228.882146:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 62 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.882156:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 62 pid: 5792 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.882165:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626622336:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378228.882201:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729240 going to sleep for 11 seconds 00000100:00100000:2.0:1787378228.883150:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604614272 00000100:00100000:2.0:1787378228.883159:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604614272 00010000:00010000:2.0:1787378228.883195:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 63 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378228.883232:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:2.0:1787378228.883249:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8a3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:2353:x1874201604614272:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378228.883260:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378228.883266:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 63 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.883278:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 63 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.883310:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:2.0:1787378228.883316:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.883322:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.883327:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378228.883588:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8a3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:2353:x1874201604614272:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 339us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.883595:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:1.0:1787378228.892323:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626622336:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378228.894573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.894673:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604614400 00000100:00100000:2.0:1787378228.894683:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604614400 00010000:00010000:2.0:1787378228.894852:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 63 pid: 5792 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378228.894892:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1787378228.894901:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:2354:x1874201604614400:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378228.894915:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378228.894922:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 63 pid: 5792 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.894948:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 63 pid: 5792 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.894971:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853aab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7153 expref: 63 pid: 5792 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.894986:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:2.0:1787378228.894991:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.894999:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.895006:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.895024:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378228.895187:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:2354:x1874201604614400:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 287us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.895196:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00010000:00010000:1.0:1787378228.896494:0:9982:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.22@tcp) returned -22 from blocking AST (req@00000000f772c5cb x1874201626622208) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 61 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.896516:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547c00/0xdd3c5462d7853ad5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7161 expref: 61 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378228.896532:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626622208:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378228.896557:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378228.896564:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.896573:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.896578:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378228.896600:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787378228.898592:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853adc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 62 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.898621:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 61 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.898630:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378228.898648:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787378228.898652:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641000, rc 0) 00000100:00100000:1.0:1787378228.898746:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11606:x1874201604614144:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 17465us (17674us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1787378228.898755:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:0.0:1787378228.904705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378228.904903:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604614656 00000100:00100000:3.0:1787378228.904912:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604614656 00000100:00100000:3.0:1787378228.905011:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1787378228.905022:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11606:x1874201604614656:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:3.0:1787378228.905037:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378228.905072:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853a42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a713e expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378228.905092:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:3.0:1787378228.905098:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378228.905164:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:11606:x1874201604614656:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 144us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378228.905172:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1787378228.910063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378228.910184:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604614784 00000100:00100000:1.0:1787378228.910194:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604614784 00000100:00100000:1.0:1787378228.910438:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:1.0:1787378228.910450:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:11606:x1874201604614784:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:1.0:1787378228.910631:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.910648:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378228.910659:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787378228.911080:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787378228.911207:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:11606:x1874201604614784:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 758us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378228.911216:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:0.0:1787378228.919775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378228.919880:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604614912 00000100:00100000:2.0:1787378228.919890:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604614912 00000100:00100000:2.0:1787378228.919940:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:2.0:1787378228.919949:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+60:11606:x1874201604614912:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378228.919969:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378228.919987:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a716f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.920062:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.920073:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a716f expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.920091:0:5791:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.920104:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a716f expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.920117:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:2.0:1787378228.920120:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378228.920124:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a716f expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378228.920131:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0a00, rc 0) 00000100:00100000:2.0:1787378228.920189:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11606:x1874201604614912:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 241us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378228.920197:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 214 00010000:00010000:2.0:1787378229.210667:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787378229.273942:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378229.273951:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378229.274006:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787378229.274031:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787378229.274167:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626622464:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787378229.274272:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787378229.278140:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626622464:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787378229.278744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.278803:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604615040 00000100:00100000:0.0:1787378229.278811:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604615040 00000100:00100000:0.0:1787378229.278894:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:0.0:1787378229.278903:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11607:x1874201604615040:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787378229.278931:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787378229.279028:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11607:x1874201604615040:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 125us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378229.279036:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00080000:1.0:1787378229.279273:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378229.284492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378229.284601:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604615168 00000100:00100000:2.0:1787378229.284611:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604615168 00000100:00100000:2.0:1787378229.284683:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:2.0:1787378229.284693:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11607:x1874201604615168:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787378229.284790:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284820:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284832:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284848:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284855:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284862:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284886:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284894:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284901:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378229.284937:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787378229.284941:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378229.284953:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284964:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284982:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284989:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.284995:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378229.284999:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285007:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285020:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:2.0:1787378229.285022:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378229.285027:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285034:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0c00/0xdd3c5462d7853aff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285058:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285063:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285069:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285073:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378229.285082:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285088:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285096:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9eeba261e600) 00010000:00010000:2.0:1787378229.285099:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378229.285102:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285307:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d7853b06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285325:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285332:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285338:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285343:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378229.285346:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285352:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285361:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:2.0:1787378229.285363:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378229.285373:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.285380:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378229.285456:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11607:x1874201604615168:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 763us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378229.285465:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:3.0:1787378229.290211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.290319:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604615424 00000100:00100000:0.0:1787378229.290329:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604615424 00000100:00100000:0.0:1787378229.290384:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:0.0:1787378229.290394:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+61:11607:x1874201604615424:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378229.290416:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378229.290436:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853b14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7176 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290530:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290545:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290556:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378229.290567:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787378229.290686:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290695:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290708:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290715:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378229.290759:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290769:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290782:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378229.290785:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787378229.290790:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290797:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290838:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853b14 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7176 expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290849:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:0.0:1787378229.290851:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378229.290855:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853b14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7176 expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.290865:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a800, rc 0) 00000100:00100000:0.0:1787378229.290925:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11607:x1874201604615424:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 532us (723us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1787378229.290941:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:3.0:1787378229.293554:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.293631:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604615552 00000100:00100000:1.0:1787378229.293641:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604615552 00000100:00100000:1.0:1787378229.293700:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:1.0:1787378229.293710:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11607:x1874201604615552:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787378229.293774:0:9982:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787378229.293876:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11607:x1874201604615552:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 166us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378229.293896:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:3.0:1787378229.304569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.304679:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604615808 00000100:00100000:0.0:1787378229.304689:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604615808 00000100:00100000:0.0:1787378229.304779:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:0.0:1787378229.304789:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11607:x1874201604615808:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378229.304810:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378229.304813:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787378229.304839:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853ab9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a715a expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.304858:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:0.0:1787378229.304863:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378229.304877:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853b29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a717d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787378229.305286:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787378229.305483:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.305496:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.305506:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.305557:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853b29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a717d expref: 64 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.305591:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a717d expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.305599:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:0.0:1787378229.305602:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378229.305604:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ac00, rc 0) 00000100:00100000:0.0:1787378229.305669:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:11607:x1874201604615808:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 881us (1112us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787378229.305678:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:3.0:1787378229.311440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.311539:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604616064 00000100:00100000:1.0:1787378229.311548:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604616064 00000100:00100000:1.0:1787378229.311608:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:1.0:1787378229.311618:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:11607:x1874201604616064:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787378229.311672:0:9982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378229.311698:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a717d expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311757:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:1.0:1787378229.311771:0:9982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787378229.311792:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311805:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311815:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311829:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311836:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311843:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311934:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311941:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311948:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311953:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378229.311957:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311964:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311973:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:1.0:1787378229.311975:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378229.311979:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311984:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311993:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.311999:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.312004:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.312015:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378229.312018:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.312024:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.312033:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3076f9d3 (ffff9eeb85524d00) 00010000:00010000:1.0:1787378229.312035:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378229.312047:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.312053:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3076f9d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.312148:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11607:x1874201604616064:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 531us (716us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787378229.312155:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:3.0:1787378229.314001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.314105:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604616192 00000100:00100000:0.0:1787378229.314114:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604616192 00000100:00100000:0.0:1787378229.314169:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:0.0:1787378229.314179:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+62:11607:x1874201604616192:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378229.314196:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378229.314219:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7184 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.314255:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.314266:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.314278:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.314373:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 64 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.314395:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.314403:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378229.314406:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787378229.314409:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128aa00, rc 0) 00000100:00100000:0.0:1787378229.314462:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:11607:x1874201604616192:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 285us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378229.314469:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:0.0:1787378229.316912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378229.321152:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604616448 00000100:00100000:2.0:1787378229.321167:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604616448 00000100:00100000:2.0:1787378229.321239:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00100000:2.0:1787378229.321250:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+63:11607:x1874201604616448:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787378229.322421:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.322441:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.322452:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787378229.324091:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787378229.324106:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365586385779ns, next at 366586383021ns, rc = 0 00000004:00010000:2.0:1787378229.324200:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e26b295a reply state 00000000436c5534 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378229.324211:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378229.324318:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+65:11607:x1874201604616448:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 3067us (7411us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787378229.324342:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00100000:3.0:1787378229.327571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:0.0:1787378229.327650:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.327663:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.327670:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.327676:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378229.327681:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.327688:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.327700:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604616576 00010000:00010000:0.0:1787378229.327703:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378229.327705:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787378229.327708:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604616576 00010000:00010000:0.0:1787378229.327746:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.327753:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d7853b5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.327787:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:1.0:1787378229.327797:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+64:11607:x1874201604616576:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378229.327819:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378229.327846:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a718b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.327899:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 65 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.327925:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 65 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.327945:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:1.0:1787378229.327948:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378229.327950:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf640800, rc 0) 00000100:00100000:1.0:1787378229.328012:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+65:11607:x1874201604616576:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 216us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378229.328028:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:3.0:1787378229.333848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.333987:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604616704 00000100:00100000:0.0:1787378229.333998:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604616704 00000100:00100000:0.0:1787378229.334058:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1787378229.334068:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2354:x1874201604616704:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787378229.334359:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:2354:x1874201604616704:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 292us (521us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787378229.334367:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1787378229.341358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.343481:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604616960 00000100:00100000:1.0:1787378229.343496:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604616960 00000100:00100000:1.0:1787378229.343580:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1787378229.343590:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+65:11607:x1874201604616960:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787378229.343878:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+66:11607:x1874201604616960:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 288us (2531us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787378229.343886:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1787378229.346286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.346490:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604617216 00000100:00100000:1.0:1787378229.346500:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604617216 00000100:00100000:1.0:1787378229.346625:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 224 00000100:00100000:1.0:1787378229.346635:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+66:11607:x1874201604617216:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787378229.346867:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+66:11607:x1874201604617216:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 232us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378229.346875:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 224 00000100:00100000:3.0:1787378229.348965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.349169:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604617344 00000100:00100000:1.0:1787378229.349192:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604617344 00000100:00100000:1.0:1787378229.349243:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:1.0:1787378229.349252:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+66:11607:x1874201604617344:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378229.349269:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378229.349289:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7192 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.349377:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640a00/0xdd3c5462d7853b6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.349391:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640a00/0xdd3c5462d7853b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.349403:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640a00/0xdd3c5462d7853b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378229.349439:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378229.349456:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640a00/0xdd3c5462d7853b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.349481:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7853b68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7192 expref: 68 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.349499:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640a00/0xdd3c5462d7853b6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7192 expref: 67 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.349508:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:1.0:1787378229.349511:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787378229.349514:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf640a00, rc 0) 00000100:00100000:1.0:1787378229.349584:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+67:11607:x1874201604617344:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 332us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378229.349597:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:0.0:1787378229.353454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378229.353555:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604617472 00000100:00100000:2.0:1787378229.353566:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604617472 00000100:00100000:2.0:1787378229.353624:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1787378229.353634:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+10:2353:x1874201604617472:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378229.353650:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378229.353672:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7199 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787378229.353697:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a893a35, blocks: 0x1 00010000:00010000:2.0:1787378229.353714:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787378229.353754:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378229.353764:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 11 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.353780:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 11 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.353793:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0c00, rc 0) 00000100:00100000:2.0:1787378229.353868:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:2353:x1874201604617472:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 235us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378229.353876:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1787378229.357850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378229.357989:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604617728 00000100:00100000:2.0:1787378229.357998:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604617728 00000100:00100000:2.0:1787378229.358075:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 226 00000100:00100000:2.0:1787378229.358085:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+67:11607:x1874201604617728:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787378229.358187:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+67:11607:x1874201604617728:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 103us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378229.358194:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 226 00000100:00100000:3.0:1787378229.360605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.360701:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604617856 00000100:00100000:0.0:1787378229.360710:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604617856 00000100:00100000:0.0:1787378229.360797:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1787378229.360815:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:11607:x1874201604617856:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378229.360838:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378229.360857:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a71a0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.360887:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 12 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.360896:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378229.360900:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378229.360918:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 12 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.360952:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 12 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.360966:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 12 pid: 6589 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378229.360981:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6586:1874201626622592:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378229.361078:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378229.366278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.366479:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604617984 00000100:00100000:1.0:1787378229.366488:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604617984 00010000:00010000:1.0:1787378229.366530:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 13 pid: 6589 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.366574:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:1.0:1787378229.366584:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:2354:x1874201604617984:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378229.366600:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378229.366625:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 13 pid: 6589 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.366639:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 13 pid: 6589 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.366667:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378229.366671:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378229.366680:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 13 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.366690:0:8358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 13 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.366762:0:8358:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 13 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.366797:0:8358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8358:1874201626622720:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787378229.366879:0:8358:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787378229.367416:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853b76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7199 expref: 13 pid: 6589 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378229.367430:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6586:1874201626622592:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378229.367452:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 12 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.367463:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a600, rc 0) 00000100:00100000:3.0:1787378229.367494:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+12:11607:x1874201604617856:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 6680us (6897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378229.367501:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:1.0:1787378229.369817:0:8358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8358:1874201626622720:192.168.203.22@tcp:105: 00010000:00010000:1.0:1787378229.369851:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378229.369891:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:2354:x1874201604617984:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 3309us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378229.369901:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:2.0:1787378229.373883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.373974:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604618112 00000100:00100000:0.0:1787378229.373984:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604618112 00002000:00100000:0.0:1787378229.374050:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9eebae989500 x1874201604618112/t0(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:300/0 lens 504/0 e 0 to 0 dl 1787378240 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378229.374062:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebae989500 with x1874201604618112 ext(0->12) 00002000:00010000:0.0:1787378229.374069:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eebae989500 00000100:00100000:0.0:1787378229.374101:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:0.0:1787378229.374112:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:2355:x1874201604618112:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787378229.374610:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:2355:x1874201604618112:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 499us (734us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787378229.374619:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00002000:00100000:0.0:1787378229.374627:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9eebae989500 x1874201604618112/t4294967320(0) o4->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:300/0 lens 504/448 e 0 to 0 dl 1787378240 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787378229.374647:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebae989500 with x1874201604618112 ext(0->12) 00002000:00010000:0.0:1787378229.374651:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eebae989500 00000100:00100000:0.0:1787378229.377036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.380464:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604618240 00000100:00100000:1.0:1787378229.380478:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604618240 00000100:00100000:0.0:1787378229.380683:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:0.0:1787378229.380693:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+67:11607:x1874201604618240:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787378229.443769:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1787378229.443797:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787378229.443818:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eeb917bfe40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787378229.443823:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb8766b900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb917bf180 00000020:00080000:3.0:1787378229.443836:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb8766bd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eebb53df800 00000004:00080000:3.0:1787378229.443865:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:3.0:1787378229.443910:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:3.0:1787378229.443933:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eeb917bf480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787378229.443936:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb98683c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb917bff00 00000020:00080000:3.0:1787378229.443939:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb98683900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb9dd00c00 00000004:00080000:3.0:1787378229.443947:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1787378229.443962:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1787378229.444270:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:11607:x1874201604618240:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 63572us (67235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378229.444281:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 227 00000020:00080000:0.0:1787378229.445849:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787378229.446081:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787378229.446365:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787378229.446386:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626622848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787378229.446449:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378229.447080:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626623104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787378229.447117:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378229.447156:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787378229.447164:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626622976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787378229.447187:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378229.447213:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626622848 00000100:00100000:3.0:1787378229.447221:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626622848 00000100:00100000:3.0:1787378229.447257:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626623104 00000100:00100000:3.0:1787378229.447261:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626623104 00000100:00100000:3.0:1787378229.447273:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626622976 00000100:00100000:3.0:1787378229.447275:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626622976 00000100:00100000:3.0:1787378229.447289:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787378229.447309:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874201626622848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787378229.447334:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1787378229.447365:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a893a34, atime: 0x6a893a34, ctime: 0x6a893a34, blocks: 0x1 00010000:00010000:3.0:1787378229.447374:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.447389:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1787378229.447393:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378229.447399:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.447434:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.447445:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.447453:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.447472:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787378229.447756:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787378229.447766:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626623104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787378229.447914:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787378229.447919:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787378229 00002000:00010000:1.0:1787378229.447921:0:8120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787378229.447924:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787378229 -> 1787378229 00002000:00010000:1.0:1787378229.447926:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787378229.447972:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1874201626623104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (853us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787378229.447991:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787378229.448010:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787378229.448017:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626622976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787378229.448655:0:8120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1787378229.448676:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.448694:0:8120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 12 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.448703:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787378229.448707:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787378229.448712:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.448766:0:8120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 12 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.448784:0:8120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 12 pid: 6589 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.448799:0:8120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8120:1874201626623232:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378229.448946:0:8120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729900 going to sleep for 11 seconds 00000004:00080000:1.0:1787378229.448990:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eebae6c5180/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787378229.448997:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626623104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787378229.452926:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874201626622848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5611us (6469us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787378229.452940:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1787378229.452975:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378229.452982:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.452996:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378229.453001:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.453012:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.453031:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378229.453230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378229.453316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378229.453346:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604618496 00000100:00100000:2.0:1787378229.453354:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604618496 00010000:00010000:2.0:1787378229.453387:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 13 pid: 6589 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378229.453415:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:2.0:1787378229.453424:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:2353:x1874201604618496:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378229.453438:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378229.453443:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 13 pid: 6589 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.453455:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 13 pid: 6589 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.453476:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787378229.453481:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787378229.453487:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.453509:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.453528:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378229.453570:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:2353:x1874201604618496:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 147us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378229.453577:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00010000:00010000:3.0:1787378229.453935:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853b84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.453956:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378229.453958:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378229.453960:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378229.454152:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604618368 00000100:00100000:0.0:1787378229.454158:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604618368 00000100:00100000:0.0:1787378229.454191:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:0.0:1787378229.454199:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+13:2354:x1874201604618368:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1787378229.459365:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eebae217b80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787378229.459380:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626622848:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787378229.459775:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853946 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70ff expref: 13 pid: 6589 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.459793:0:8120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8120:1874201626623232:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378229.459815:0:8120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.461535:0:8120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.461553:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.461565:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.461573:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.461598:0:8120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378229.461932:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378229.461940:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.461950:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378229.461955:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.461965:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.461987:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.462008:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002866be82/0xdd3c5462d7853b8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.462029:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378229.462031:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378229.462809:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1874201626622976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14786us (15614us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787378229.462819:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1787378229.462898:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eebae6c4000/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787378229.462905:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626622976:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787378229.462970:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787378229.498747:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1787378229.498776:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1787378229.499004:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604618368:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 44798us (45769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378229.499016:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:2.0:1787378229.501604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.501696:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604618752 00000100:00100000:0.0:1787378229.501705:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604618752 00000100:00100000:0.0:1787378229.501786:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:0.0:1787378229.501797:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:11607:x1874201604618752:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787378229.501918:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378229.501946:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640a00/0xdd3c5462d7853b6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7192 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.501966:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378229.501971:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378229.502002:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.502015:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.502025:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787378229.502486:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d284949 reply state 00000000a3bf4001 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378229.502496:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787378229.502638:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:11607:x1874201604618752:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 842us (1043us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787378229.502647:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:1.0:1787378229.513175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.513249:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604618880 00000100:00100000:0.0:1787378229.513259:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604618880 00000100:00100000:0.0:1787378229.513322:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:0.0:1787378229.513333:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604618880:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787378229.513537:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787378229.513541:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787378229 -> 1787378228 00002000:00010000:0.0:1787378229.513544:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787378228 00002000:00010000:0.0:1787378229.513546:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787378229 -> 1787378228 00002000:00010000:0.0:1787378229.513548:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787378229.513603:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2355:x1874201604618880:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 271us (435us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1787378229.513611:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00010000:00010000:3.0:1787378229.514126:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.514138:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.514146:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.514152:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378229.514157:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.514165:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.514182:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:3.0:1787378229.514185:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378229.514190:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.514195:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853b92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378229.518286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.518468:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604619136 00000100:00100000:1.0:1787378229.518478:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604619136 00000100:00100000:1.0:1787378229.518542:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:1.0:1787378229.518552:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:11607:x1874201604619136:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787378229.518617:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.518634:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.518643:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.518677:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.518691:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 20 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.518705:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626623360:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378229.518825:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378229.526579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.526752:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874201626623360:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378229.526778:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378229.526881:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604619264 00000100:00100000:3.0:1787378229.526887:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604619264 00010000:00010000:3.0:1787378229.526921:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 21 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378229.526969:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:3.0:1787378229.526978:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae216d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:2354:x1874201604619264:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378229.526991:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378229.526997:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 21 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.527009:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 21 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.527030:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853b53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7184 expref: 21 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.527059:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:3.0:1787378229.527064:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.527073:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.527081:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.527109:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378229.527170:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae216d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:2354:x1874201604619264:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 191us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378229.527178:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00010000:00010000:1.0:1787378229.527271:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.527278:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.527317:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.527325:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.527331:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.527337:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378229.527341:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.527348:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.527360:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:1.0:1787378229.527362:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787378229.527366:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.527372:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853b99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.527413:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:11607:x1874201604619136:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 8862us (9136us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787378229.527427:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:2.0:1787378229.532281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.532363:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604619392 00000100:00100000:1.0:1787378229.532374:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604619392 00000100:00100000:1.0:1787378229.532484:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:1.0:1787378229.532494:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2356:x1874201604619392:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787378229.532542:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.532564:0:8120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.532572:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378229.532576:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787378229.532580:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.532618:0:8120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.532633:0:8120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 8 pid: 6586 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.532645:0:8120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8120:1874201626623488:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378229.532761:0:8120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729240 going to sleep for 11 seconds 00000100:00100000:2.0:1787378229.536685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.536835:0:8120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8120:1874201626623488:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378229.536874:0:8120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378229.537111:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604619520 00000100:00100000:3.0:1787378229.537119:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604619520 00010000:00010000:3.0:1787378229.537157:0:8358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 9 pid: 6586 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378229.537195:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:3.0:1787378229.537205:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+9:2353:x1874201604619520:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378229.537220:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378229.537243:0:8358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 9 pid: 6586 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.537257:0:8358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 9 pid: 6586 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.537281:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a619163d/0xdd3c5462d7853b7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a0 expref: 9 pid: 6586 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.537297:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378229.537301:0:8358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787378229.537307:0:8358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.537316:0:8358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378229.537358:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378229.537412:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604619520:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 208us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378229.537419:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00010000:00010000:1.0:1787378229.537547:0:8120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.537557:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.537580:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.537588:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.537596:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.537603:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf641200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378229.537608:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.537616:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.537628:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.537643:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ab1ec50/0xdd3c5462d7853ba0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.537687:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2356:x1874201604619392:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 5195us (5415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378229.537695:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:2.0:1787378229.540517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378229.540609:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604619776 00000100:00100000:1.0:1787378229.540619:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604619776 00000100:00100000:1.0:1787378229.540686:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:1.0:1787378229.540696:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:11607:x1874201604619776:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787378229.540813:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.540841:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.540854:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.541068:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.541079:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.541088:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.541143:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.541168:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 20 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.541184:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626623616:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378229.541254:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729240 going to sleep for 11 seconds 00000100:00100000:0.0:1787378229.549316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378229.549516:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604619904 00000100:00100000:2.0:1787378229.549524:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604619904 00010000:00010000:2.0:1787378229.549565:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 21 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378229.549608:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:2.0:1787378229.549618:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8a3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:2354:x1874201604619904:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378229.549632:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378229.549638:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 21 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.549650:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 21 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.549691:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:2.0:1787378229.549697:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.549706:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.549714:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.549922:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378229.549980:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8a3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:2354:x1874201604619904:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 364us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378229.549989:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00010000:00010000:1.0:1787378229.552487:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853b61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a718b expref: 20 pid: 5790 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.552514:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626623616:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378229.552538:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.552549:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.552555:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787378229.552851:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787378229.553016:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1787378229.553078:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787378229.553166:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626623744:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787378229.553228:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378229.553267:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378229.553412:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626623744 00000100:00100000:2.0:1787378229.553419:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626623744 00000100:00100000:2.0:1787378229.553474:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787378229.553483:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9982:x1874201626623744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787378229.553560:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9982:x1874201626623744:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378229.553567:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787378229.554798:0:9982:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787378229.554807:0:9982:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1787378229.554827:0:9982:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eebae6c5180, transno 4294967321 00000100:00100000:1.0:1787378229.554853:0:9982:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9eebae6c4000 x1874201626622976/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787378245 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378229.554865:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626623744:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787378229.555860:0:9982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1787378229.555927:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626623872:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787378229.560450:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378229.560503:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378229.560688:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626623872 00000100:00100000:2.0:1787378229.560698:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626623872 00000100:00100000:2.0:1787378229.561117:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787378229.561128:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9982:x1874201626623872:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787378229.561381:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9982:x1874201626623872:12345-0@lo:1000:mdt00_003.0 Request processed in 255us (939us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787378229.561406:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787378229.561487:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9982:1874201626623872:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787378229.561531:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561542:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561550:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561555:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378229.561560:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561567:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561582:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:1.0:1787378229.561585:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378229.561595:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561601:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853bae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561630:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561637:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561642:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561646:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378229.561649:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561655:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561663:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378229.561666:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378229.561673:0:9982:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a716f expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561685:0:9982:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a716f expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561695:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a716f expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.561775:0:9982:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a716f expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.561790:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626624000:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787378229.561858:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb86729240 going to sleep for 11 seconds 00000100:00100000:1.0:1787378229.567234:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9982:1874201626624000:192.168.203.22@tcp:105: 00010000:00010000:1.0:1787378229.567266:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567277:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853af1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567323:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567336:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567348:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567359:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567365:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567371:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567394:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378229.567398:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567405:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567417:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378229.567420:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378229.567424:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567429:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853bb5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567438:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567443:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567449:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567453:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378229.567455:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567461:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567479:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378229.567482:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787378229.567485:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378229.567491:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853ba7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.567709:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:11607:x1874201604619776:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 27013us (27199us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1787378229.567752:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 230 00000020:00080000:1.0:1787378229.567758:0:9982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787378229.575388:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378229.575398:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378229.575885:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787378229.575894:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787378229.576759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378229.576937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.577110:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604620032 00000100:00100000:0.0:1787378229.577261:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604620032 00000100:00100000:0.0:1787378229.577301:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604620288 00000100:00100000:0.0:1787378229.577304:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604620288 00000100:00100000:0.0:1787378229.577321:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1787378229.577330:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:11606:x1874201604620032:12345-192.168.203.22@tcp:49:lfs.0 00000100:00100000:0.0:1787378229.577620:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+24:11606:x1874201604620032:12345-192.168.203.22@tcp:49:lfs.0 Request processed in 290us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378229.577628:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1787378229.577646:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1787378229.577654:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+23:11607:x1874201604620288:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787378229.578597:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787378229.578713:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1787378229.578821:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.578838:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.579140:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.579152:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.579159:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.579165:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.579221:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787378229.579312:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:11607:x1874201604620288:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1656us (2374us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787378229.579320:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000020:00080000:0.0:1787378229.579333:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787378229.579715:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787378229.579784:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.579792:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378229.579796:0:6602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.579803:0:6602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.579816:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eeb829cdd00) 00010000:00010000:2.0:1787378229.579820:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787378229.579824:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.579829:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.579847:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378229.579849:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378229.579921:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378229.587842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.588129:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604620544 00000100:00100000:0.0:1787378229.588138:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604620544 00000100:00100000:0.0:1787378229.588201:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00100000:0.0:1787378229.588212:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:11606:x1874201604620544:12345-192.168.203.22@tcp:58:lfs.0 00000040:00080000:0.0:1787378229.588646:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787378229.588770:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:11606:x1874201604620544:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 558us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378229.588780:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00100000:1.0:1787378229.627648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.627815:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604620672 00000100:00100000:0.0:1787378229.627824:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604620672 00000100:00100000:0.0:1787378229.627888:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:0.0:1787378229.627898:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+25:11609:x1874201604620672:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378229.627922:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378229.627942:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a71a7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628001:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628015:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628026:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628052:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628061:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628082:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628358:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628371:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 26 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628391:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628424:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 26 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.628447:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 26 pid: 9982 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378229.628463:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae216a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626624128:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378229.628558:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c5d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787378229.632131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.632286:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae216a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874201626624128:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378229.632314:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378229.632760:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604620928 00000100:00100000:1.0:1787378229.632767:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604620928 00000100:00100000:1.0:1787378229.632814:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:1.0:1787378229.633277:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:5568:x1874201604620928:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787378229.633768:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:5568:x1874201604620928:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 944us (1643us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787378229.633778:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1787378229.635817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378229.636071:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604621056 00000100:00100000:0.0:1787378229.636080:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604621056 00010000:00010000:0.0:1787378229.636117:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 28 pid: 9982 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378229.636177:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:0.0:1787378229.636186:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:2353:x1874201604621056:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378229.636200:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378229.636207:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 28 pid: 9982 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.636220:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 28 pid: 9982 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.636244:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641000/0xdd3c5462d7853ae3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7168 expref: 28 pid: 9982 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.636260:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378229.636265:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.636275:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.636283:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378229.636323:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378229.636380:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:2353:x1874201604621056:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 193us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378229.636387:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00010000:00010000:2.0:1787378229.636562:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636582:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378229.636623:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787378229.636627:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378229.636710:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636760:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636772:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636779:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636785:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636791:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378229.636794:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636802:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636812:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:2.0:1787378229.636815:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378229.636818:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636957:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ac00/0xdd3c5462d7853bca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636969:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636974:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636980:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636984:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378229.636988:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.636993:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.637001:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eeb829cdb00) 00010000:00010000:2.0:1787378229.637004:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378229.637006:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.637013:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b600/0xdd3c5462d7853bd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.637057:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a7 expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.637069:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a7 expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378229.637083:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:2.0:1787378229.637086:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378229.637088:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128aa00, rc 0) 00000100:00100000:2.0:1787378229.637121:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:11609:x1874201604620672:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 9224us (9481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378229.637129:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 232 00010000:00010000:3.0:1787378230.234559:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787378230.372542:0:12410:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378230.372552:0:12410:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378230.372600:0:12410:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787378230.372624:0:12410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787378230.618200:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378230.618212:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378230.618254:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787378230.618260:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787378230.618398:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626624256:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787378230.618692:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89913300 going to sleep for 11 seconds 00000100:00100000:2.0:1787378230.622790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378230.623072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604621184 00000100:00100000:0.0:1787378230.623095:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604621184 00000100:00100000:0.0:1787378230.623162:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:0.0:1787378230.623174:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:11622:x1874201604621184:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787378230.623217:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787378230.623345:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+27:11622:x1874201604621184:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 173us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378230.623354:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:3.0:1787378230.624592:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1874201626624256:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787378230.626217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378230.626311:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604621440 00000100:00100000:1.0:1787378230.626320:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604621440 00000100:00100000:1.0:1787378230.626373:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:1.0:1787378230.626381:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+26:11622:x1874201604621440:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378230.626402:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378230.626420:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853bdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a71ae expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378230.626525:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853be6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378230.626540:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378230.626551:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378230.626562:0:9982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787378230.626680:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d7853bdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71ae expref: 29 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378230.626699:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71ae expref: 28 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378230.626708:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378230.626711:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787378230.626714:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf640200, rc 0) 00000100:00100000:1.0:1787378230.626832:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:11622:x1874201604621440:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 450us (620us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787378230.626839:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:2.0:1787378230.630459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378230.630554:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604621696 00000100:00100000:0.0:1787378230.630563:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604621696 00000100:00100000:0.0:1787378230.630624:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 235 00000100:00100000:0.0:1787378230.630633:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8455bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+28:11622:x1874201604621696:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787378230.630715:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.630770:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.630783:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.630971:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.630980:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.630988:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.631010:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378230.631015:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.631023:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.631047:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378230.631050:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787378230.631055:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378230.631061:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d7853bf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378230.631203:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8455bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:11622:x1874201604621696:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 570us (751us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787378230.631213:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 235 00000040:00080000:3.0:1787378230.631490:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378230.631495:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378230.632102:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787378230.632132:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787378230.635436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378230.635478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378230.635578:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604621952 00000100:00100000:0.0:1787378230.635588:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604621952 00000100:00100000:0.0:1787378230.635647:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1787378230.635658:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:11622:x1874201604621952:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787378230.635929:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:11622:x1874201604621952:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 273us (500us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787378230.635938:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:2.0:1787378230.637809:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604622080 00000100:00100000:2.0:1787378230.637877:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604622080 00000100:00100000:2.0:1787378230.638002:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1787378230.638012:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+30:2356:x1874201604622080:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378230.638039:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378230.638067:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640200/0xdd3c5462d7853be6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71ae expref: 30 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378230.638088:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:2.0:1787378230.638093:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378230.638151:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:2356:x1874201604622080:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 140us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378230.638170:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1787378230.906838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378230.906903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378230.906952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378230.906991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378230.907187:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604622208 00000100:00100000:2.0:1787378230.907196:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604622208 00000100:00100000:2.0:1787378230.907258:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:2.0:1787378230.907268:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604622208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378230.907354:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604622208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 87us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378230.907362:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:1.0:1787378230.908081:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604622336 00000100:00100000:1.0:1787378230.908087:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604622336 00000100:00100000:1.0:1787378230.908141:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604622464 00000100:00100000:1.0:1787378230.908144:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604622464 00000100:00100000:1.0:1787378230.908167:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:1.0:1787378230.908174:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604622336:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378230.908219:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604622336:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 45us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378230.908226:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:1.0:1787378230.908240:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:1.0:1787378230.908247:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604622464:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378230.908280:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2354:x1874201604622464:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378230.908286:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:0.0:1787378230.908320:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604622592 00000100:00100000:0.0:1787378230.908326:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604622592 00000100:00100000:0.0:1787378230.908377:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:0.0:1787378230.908386:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604622592:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378230.908419:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2354:x1874201604622592:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378230.908426:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00080000:2.0:1787378230.909057:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378230.909062:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378230.909064:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787378231.258087:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787378231.366766:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787378231.366949:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:0.0:1787378232.029541:0:12463:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787378232.029549:0:12463:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787378232.029609:0:12463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787378232.029615:0:12463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787378232.198011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378232.198100:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604622848 00000100:00100000:1.0:1787378232.198109:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604622848 00000100:00100000:1.0:1787378232.198202:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 236 00000100:00100000:1.0:1787378232.198211:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+29:11642:x1874201604622848:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378232.198235:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378232.198254:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641e00/0xdd3c5462d7853bfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a71b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378232.198356:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d7853c02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378232.198382:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d7853c02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378232.198395:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d7853c02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378232.198407:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787378232.198529:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641e00/0xdd3c5462d7853bfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71b5 expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378232.198559:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d7853c02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71b5 expref: 31 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378232.198568:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:1.0:1787378232.198571:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787378232.198574:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641600, rc 0) 00000100:00100000:1.0:1787378232.198661:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:11642:x1874201604622848:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 450us (658us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787378232.198668:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 236 00000100:00080000:2.0:1787378232.199532:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378232.201357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378232.201421:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604622976 00000100:00100000:0.0:1787378232.201444:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604622976 00000100:00100000:0.0:1787378232.201498:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:0.0:1787378232.201507:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eea830d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:11642:x1874201604622976:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787378232.201566:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201581:0:9982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201592:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201615:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201620:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201639:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201644:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378232.201649:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201656:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201666:0:9982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:0.0:1787378232.201669:0:9982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378232.201673:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378232.201679:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7853c10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378232.202480:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eea830d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+31:11642:x1874201604622976:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 970us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378232.202490:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 237 00010000:00010000:2.0:1787378232.284158:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378232.287158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378232.287251:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604623104 00000100:00100000:3.0:1787378232.287261:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604623104 00000100:00100000:3.0:1787378232.287337:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1787378232.287348:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604623104:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:3.0:1787378232.287366:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378232.287389:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853c17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a71bc expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787378232.287418:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a893a34, atime: 0x6a893a34, ctime: 0x6a893a34, blocks: 0xb 00010000:00010000:3.0:1787378232.287439:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1787378232.287444:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378232.287452:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853c17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71bc expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378232.287468:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853c17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71bc expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378232.287483:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04000, rc 0) 00000100:00100000:3.0:1787378232.287546:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2353:x1874201604623104:12345-192.168.203.22@tcp:101:cat.0 Request processed in 199us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378232.287554:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00080000:2.0:1787378232.288013:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787378232.291195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378232.291296:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604623232 00000100:00100000:1.0:1787378232.291306:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604623232 00002000:00100000:1.0:1787378232.291355:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9eebad233800 x1874201604623232/t0(0) o3->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:303/0 lens 488/0 e 0 to 0 dl 1787378243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787378232.291366:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebad233800 with x1874201604623232 ext(0->4095) 00002000:00010000:1.0:1787378232.291386:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eebad233800 00000100:00100000:1.0:1787378232.291418:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787378232.291427:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604623232:12345-192.168.203.22@tcp:3:cat.0 00000100:00100000:1.0:1787378232.291653:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+8:2354:x1874201604623232:12345-192.168.203.22@tcp:3:cat.0 Request processed in 226us (465us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787378232.291663:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00002000:00100000:1.0:1787378232.291669:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9eebad233800 x1874201604623232/t0(0) o3->3ca7eed4-13a1-4f52-9d12-97b20fe7905e@192.168.203.22@tcp:303/0 lens 488/4536 e 0 to 0 dl 1787378243 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787378232.291678:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9eebad233800 with x1874201604623232 ext(0->4095) 00002000:00010000:1.0:1787378232.291681:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eebad233800 00010000:00010000:1.0:1787378233.309123:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378233.371174:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626624384:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371244:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378233.371298:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626624896:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378233.371352:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378233.371358:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbf634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626624768:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371383:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378233.371411:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626624512:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378233.371450:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626625024:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378233.371486:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378233.371492:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626624640:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378233.371549:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626624896 00000100:00100000:1.0:1787378233.371556:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626624896 00000100:00100000:1.0:1787378233.371604:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626624512 00000100:00100000:1.0:1787378233.371608:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626624512 00000100:00100000:1.0:1787378233.371620:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626624640 00000100:00100000:1.0:1787378233.371623:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626624640 00000100:00100000:1.0:1787378233.371638:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787378233.371645:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626624896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371696:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626624896:12345-0@lo:400:kworker.0 Request processed in 50us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378233.371703:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787378233.371744:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787378233.371760:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626624512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371795:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626624512:12345-0@lo:400:kworker.0 Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378233.371801:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787378233.371813:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787378233.371819:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626624640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371843:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626624640:12345-0@lo:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378233.371849:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787378233.371866:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626624768 00000100:00100000:1.0:1787378233.371869:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626624768 00000100:00100000:1.0:1787378233.371893:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626625024 00000100:00100000:1.0:1787378233.371896:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626625024 00000100:00100000:1.0:1787378233.371917:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787378233.371924:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626624768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371951:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626624768:12345-0@lo:400:kworker.0 Request processed in 27us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378233.371956:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787378233.371967:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787378233.371973:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626625024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.371996:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626625024:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378233.372001:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1787378233.372032:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378233.372036:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787378233.372039:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378233.372073:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626624640:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.372092:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626624512:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.372101:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626625024:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.372129:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787378233.372134:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787378233.372150:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eebae217b80, transno 4294967310 00000100:00100000:1.0:1787378233.372167:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbf634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626624768:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.372178:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb3dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626624896:0@lo:400:kworker.0 00000100:00100000:0.0:1787378233.372454:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626624384 00000100:00100000:0.0:1787378233.372459:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626624384 00000100:00100000:0.0:1787378233.372488:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787378233.372495:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626624384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378233.372533:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626624384:12345-0@lo:400:kworker.0 Request processed in 38us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378233.372539:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787378233.372628:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626624384:0@lo:400:kworker.0 00000100:00100000:1.0:1787378233.882077:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378233.882103:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626625152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378233.882188:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378233.882299:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626625152 00000100:00100000:3.0:1787378233.882319:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626625152 00000100:00100000:3.0:1787378233.882408:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787378233.882419:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626625152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378233.882453:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378233.882510:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626625152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378233.882518:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787378233.882672:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626625152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378233.884241:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626625280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378233.884302:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378233.884428:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626625280 00000100:00100000:2.0:1787378233.884434:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626625280 00000100:00100000:2.0:1787378233.884477:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787378233.884485:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626625280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787378233.884516:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378233.884653:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874201626625280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378233.884661:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787378233.889074:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626625280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787378234.341011:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787378234.454981:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787378234.455020:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1787378234.455043:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787378234.455062:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eeb913a3000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787378234.455066:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb98683300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eeb913a3d80 00000020:00080000:3.0:1787378234.455069:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9eeb98683500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eebaf42a800 00000020:00080000:2.0:1787378234.455354:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787378234.455572:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000040:00080000:3.0:1787378234.714774:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378234.714784:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378234.714940:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787378234.714946:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787378234.959572:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1787378234.959591:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787378234.959599:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1787378235.358424:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378236.029291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378236.029331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378236.029366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378236.029448:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604623360 00000100:00100000:3.0:1787378236.029458:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604623360 00000100:00100000:0.0:1787378236.029462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378236.029514:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604623616 00000100:00100000:1.0:1787378236.029519:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604623616 00000100:00100000:3.0:1787378236.029522:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:3.0:1787378236.029534:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2353:x1874201604623360:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378236.029566:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:1.0:1787378236.029575:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604623616:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378236.029605:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a49b169-b438-4a59-90b0-00ee704ad017+13:2353:x1874201604623360:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 72us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378236.029614:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2353:x1874201604623616:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378236.029616:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:1.0:1787378236.029628:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00080000:1.0:1787378236.029665:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378236.035710:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604623872 00000100:00100000:2.0:1787378236.035745:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604623872 00000100:00100000:1.0:1787378236.036677:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604623488 00000100:00100000:1.0:1787378236.036685:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604623488 00000100:00100000:1.0:1787378236.036758:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:1.0:1787378236.036770:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604623872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378236.036876:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:3.0:1787378236.036888:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:2353:x1874201604623488:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378236.037225:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2353:x1874201604623872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 456us (7856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378236.037234:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:3.0:1787378236.037255:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:2353:x1874201604623488:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 367us (7792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378236.037329:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00080000:1.0:1787378236.037508:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378236.042836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378236.042939:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604623744 00000100:00100000:0.0:1787378236.042949:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604623744 00000100:00100000:3.0:1787378236.044520:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:3.0:1787378236.044536:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604623744:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378236.044615:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2353:x1874201604623744:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 84us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378236.044623:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00080000:1.0:1787378236.051762:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787378236.377920:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378237.009144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378237.009266:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604624000 00000100:00100000:2.0:1787378237.009277:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604624000 00000100:00100000:2.0:1787378237.009376:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:2.0:1787378237.009387:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb84558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11287:x1874201604624000:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787378237.009549:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb84558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11287:x1874201604624000:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 163us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378237.009558:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:3.0:1787378237.012288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378237.012486:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604624256 00000100:00100000:1.0:1787378237.012496:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604624256 00000100:00100000:1.0:1787378237.012555:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:1.0:1787378237.012565:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:11287:x1874201604624256:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787378237.013285:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:11287:x1874201604624256:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 719us (1004us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787378237.013295:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:3.0:1787378237.259877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378237.260006:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604624384 00000100:00100000:1.0:1787378237.260016:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604624384 00000100:00100000:1.0:1787378237.260080:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00100000:1.0:1787378237.260090:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:12094:x1874201604624384:12345-192.168.203.22@tcp:101:lsof.0 00010000:00010000:1.0:1787378237.260110:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378237.260132:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a71c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378237.260218:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853c25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378237.260232:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378237.260254:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378237.260442:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787378237.260446:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378237.260524:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378237.260550:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7853c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71c3 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378237.260567:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853c25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71c3 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378237.260576:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:1.0:1787378237.260579:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787378237.260583:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf640c00, rc 0) 00000100:00100000:1.0:1787378237.260651:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:12094:x1874201604624384:12345-192.168.203.22@tcp:101:lsof.0 Request processed in 563us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378237.260659:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 239 00010000:00010000:3.0:1787378237.402145:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378238.426430:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378238.490264:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626625792:0@lo:400:kworker.0 00000100:00100000:3.0:1787378238.490366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378238.490433:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787378238.490441:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626625408:0@lo:400:kworker.0 00000100:00100000:3.0:1787378238.490472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378238.490492:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626625920:0@lo:400:kworker.0 00000100:00100000:3.0:1787378238.490517:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378238.491212:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626625536:0@lo:400:kworker.0 00000100:00100000:0.0:1787378238.491265:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378238.491296:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626626048:0@lo:400:kworker.0 00000100:00100000:0.0:1787378238.491321:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378238.491351:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787378238.491358:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626625664:0@lo:400:kworker.0 00000100:00100000:0.0:1787378238.491381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378238.491463:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626625920 00000100:00100000:2.0:1787378238.491472:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626625920 00000100:00100000:2.0:1787378238.491529:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626625536 00000100:00100000:2.0:1787378238.491532:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626625536 00000100:00100000:2.0:1787378238.491544:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626625664 00000100:00100000:2.0:1787378238.491546:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626625664 00000100:00100000:2.0:1787378238.491559:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787378238.491566:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626625920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378238.491636:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626625920:12345-0@lo:400:kworker.0 Request processed in 70us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378238.491644:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787378238.491661:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787378238.491667:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626625536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378238.491696:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626625536:12345-0@lo:400:kworker.0 Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378238.491702:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787378238.491746:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787378238.491752:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626625664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378238.491796:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626625664:12345-0@lo:400:kworker.0 Request processed in 45us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378238.491803:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787378238.492176:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626625792 00000100:00100000:3.0:1787378238.492182:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626625792 00000100:00100000:3.0:1787378238.492220:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626626048 00000100:00100000:3.0:1787378238.492223:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626626048 00000100:00100000:3.0:1787378238.492258:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787378238.492266:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626625792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378238.492301:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626625792:12345-0@lo:400:kworker.0 Request processed in 38us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378238.492320:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787378238.492331:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787378238.492337:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626626048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378238.492362:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626626048:12345-0@lo:400:kworker.0 Request processed in 26us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378238.492368:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787378238.492407:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626625920:0@lo:400:kworker.0 00000100:00100000:3.0:1787378238.492418:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626625792:0@lo:400:kworker.0 00000100:00080000:0.0:1787378238.492747:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787378238.492753:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787378238.492755:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378238.492793:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626625664:0@lo:400:kworker.0 00000100:00100000:0.0:1787378238.492806:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626625536:0@lo:400:kworker.0 00000100:00100000:0.0:1787378238.492814:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787378238.492818:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eebae6c4000, transno 4294967322 00000004:00080000:0.0:1787378238.492836:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787378238.492851:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626626048:0@lo:400:kworker.0 00000100:00100000:1.0:1787378238.495674:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626625408 00000100:00100000:1.0:1787378238.495690:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626625408 00000100:00100000:1.0:1787378238.495810:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787378238.495820:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626625408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378238.496086:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626625408:12345-0@lo:400:kworker.0 Request processed in 266us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378238.496094:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787378238.496578:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626625408:0@lo:400:kworker.0 00000100:00100000:0.0:1787378239.003000:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626626176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378239.003090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378239.003222:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626626176 00000100:00100000:3.0:1787378239.003231:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626626176 00000100:00100000:3.0:1787378239.003301:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787378239.003310:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626626176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378239.003345:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378239.003394:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626626176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378239.003400:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787378239.003442:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626626176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378239.003833:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378239.003845:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626626304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378239.003877:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378239.003957:0:11748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626626304 00000100:00100000:0.0:1787378239.003962:0:11748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626626304 00000100:00100000:0.0:1787378239.004013:0:11748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787378239.004020:0:11748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626626304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378239.004041:0:11748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378239.004081:0:11748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626626304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378239.004087:0:11748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787378239.004156:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626626304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787378239.449880:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787378239.598963:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1787378239.598994:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787378239.599052:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787378239.599062:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787378240.474737:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787378241.020596:0:12667:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:57:19 (1787378239) 00000100:00100000:3.0:1787378241.147956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378241.148016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378241.148053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378241.148075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378241.148105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378241.148163:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604625024 00000100:00100000:2.0:1787378241.148336:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604624768 00000100:00100000:2.0:1787378241.148349:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604624768 00000100:00100000:2.0:1787378241.148422:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604624896 00000100:00100000:2.0:1787378241.148426:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604624896 00000100:00100000:2.0:1787378241.148458:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:2.0:1787378241.148469:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604624768:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378241.148561:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2355:x1874201604624768:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 93us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378241.148570:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:2.0:1787378241.148593:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:2.0:1787378241.148600:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604624896:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378241.148640:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2355:x1874201604624896:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378241.148647:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:2.0:1787378241.148668:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604624640 00000100:00100000:2.0:1787378241.148672:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604624640 00000100:00100000:2.0:1787378241.148703:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:2.0:1787378241.148711:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:2355:x1874201604624640:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378241.148766:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:2355:x1874201604624640:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 56us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378241.148773:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00080000:2.0:1787378241.148792:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378241.148798:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378241.148800:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787378241.149258:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604625024 00000100:00100000:2.0:1787378241.149926:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:2.0:1787378241.149946:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2355:x1874201604625024:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378241.150043:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2355:x1874201604625024:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378241.150051:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:0.0:1787378241.150512:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604624512 00000100:00100000:0.0:1787378241.150520:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604624512 00000100:00100000:0.0:1787378241.150568:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 303 00000100:00100000:0.0:1787378241.150577:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604624512:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378241.150618:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2355:x1874201604624512:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 43us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378241.150625:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 303 00000100:00080000:3.0:1787378241.151270:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787378241.507491:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378242.524150:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378243.547472:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378243.611755:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626626560:0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.611826:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378243.611889:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626627072:0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.611915:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378243.611953:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378243.611959:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626626688:0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.611981:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378243.612010:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626627072 00000100:00100000:2.0:1787378243.612017:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626627072 00000100:00100000:2.0:1787378243.612080:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787378243.612085:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626626432:0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.612094:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626627072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378243.612129:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378243.612166:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626626944:0@lo:400:kworker.0 00000100:00100000:0.0:1787378243.612230:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626626560 00000100:00100000:0.0:1787378243.612235:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626626560 00000100:00100000:0.0:1787378243.612264:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626626688 00000100:00100000:0.0:1787378243.612267:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626626688 00000100:00100000:0.0:1787378243.612286:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787378243.612292:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626626560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378243.612355:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626626816:0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.612661:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626627072:12345-0@lo:400:kworker.0 Request processed in 570us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378243.612670:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787378243.612676:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378243.612705:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626626944 00000100:00100000:2.0:1787378243.612711:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626626944 00000100:00100000:1.0:1787378243.612713:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626626432 00000100:00100000:2.0:1787378243.612760:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787378243.612766:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626626688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.612799:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626626688:12345-0@lo:400:kworker.0 Request processed in 33us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378243.612805:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787378243.612819:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787378243.612838:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626626944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378243.612842:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626626432 00000100:00100000:1.0:1787378243.612878:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787378243.612889:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626626944:12345-0@lo:400:kworker.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378243.612890:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626626432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.612904:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787378243.612935:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626626432:12345-0@lo:400:kworker.0 Request processed in 49us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378243.612955:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787378243.612967:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626626688:0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.612984:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626627072:0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.613022:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626626432:0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.613032:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626626944:0@lo:400:kworker.0 00000100:00080000:2.0:1787378243.613069:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378243.613073:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787378243.617819:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626626560:12345-0@lo:400:kworker.0 Request processed in 5515us (5981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378243.617847:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787378243.622766:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626626560:0@lo:400:kworker.0 00000100:00100000:3.0:1787378243.625714:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378243.630426:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626626816 00000100:00100000:2.0:1787378243.630441:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626626816 00000100:00100000:2.0:1787378243.630649:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787378243.630661:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626626816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378243.630780:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626626816:12345-0@lo:400:kworker.0 Request processed in 122us (5072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378243.630788:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787378243.630875:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb53e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626626816:0@lo:400:kworker.0 00000100:00080000:3.0:1787378243.630982:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378244.121956:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378244.121981:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626627200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378244.122040:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787378244.122052:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626627328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378244.122068:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378244.122753:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378244.128882:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626627200 00000100:00100000:0.0:1787378244.128896:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626627200 00000100:00100000:0.0:1787378244.129286:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626627328 00000100:00100000:0.0:1787378244.129291:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626627328 00000100:00100000:3.0:1787378244.129318:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787378244.130331:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626627200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787378244.130379:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378244.130398:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787378244.130412:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626627328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378244.130436:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378244.130454:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626627200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1119us (8386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378244.130462:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787378244.130501:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626627328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (7781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378244.130509:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787378244.130576:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626627200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378244.131903:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626627328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787378244.570410:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378244.820497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378244.820624:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604625280 00000100:00100000:1.0:1787378244.820635:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604625280 00000100:00100000:1.0:1787378244.820714:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:1.0:1787378244.820759:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+18:12316:x1874201604625280:12345-192.168.203.22@tcp:35:umount.0 00000100:00080000:3.0:1787378244.821303:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378244.821880:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:12316:x1874201604625280:12345-192.168.203.22@tcp:35:umount.0 Request processed in 1121us (1388us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787378244.821892:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:0.0:1787378244.834674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378244.835311:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604625536 00000100:00100000:2.0:1787378244.835322:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604625536 00000100:00100000:2.0:1787378244.835381:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1787378244.835391:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+19:12316:x1874201604625536:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:2.0:1787378244.835781:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:12316:x1874201604625536:12345-192.168.203.22@tcp:35:umount.0 Request processed in 389us (1115us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787378244.835789:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1787378244.839701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378244.843084:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604625792 00000100:00100000:0.0:1787378244.843108:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604625792 00000100:00100000:0.0:1787378244.843178:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:0.0:1787378244.843189:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb863ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+20:12316:x1874201604625792:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:0.0:1787378244.843664:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb863ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:12316:x1874201604625792:12345-192.168.203.22@tcp:35:umount.0 Request processed in 475us (3970us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787378244.843672:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:3.0:1787378244.847948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378244.848264:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604626048 00000100:00100000:0.0:1787378244.848275:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604626048 00000100:00100000:0.0:1787378244.848343:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:0.0:1787378244.848354:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+21:12316:x1874201604626048:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:0.0:1787378244.848695:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:12316:x1874201604626048:12345-192.168.203.22@tcp:35:umount.0 Request processed in 341us (764us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787378244.848704:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1787378244.854916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378244.855041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378244.855185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378244.863120:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604626176 00000100:00100000:0.0:1787378244.863138:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604626176 00000100:00100000:0.0:1787378244.863226:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604626560 00000100:00100000:0.0:1787378244.863230:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604626560 00000100:00100000:0.0:1787378244.863268:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1787378244.863277:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a49b169-b438-4a59-90b0-00ee704ad017+14:2354:x1874201604626176:12345-192.168.203.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787378244.863440:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787378244.863450:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a49b169-b438-4a59-90b0-00ee704ad017+14:2354:x1874201604626560:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378244.863458:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378244.863477:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04200/0xdd3c5462d7852eb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e19 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378244.863494:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378244.863554:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a49b169-b438-4a59-90b0-00ee704ad017+13:2354:x1874201604626560:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 106us (8513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378244.863562:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00010000:00010000:0.0:1787378244.864292:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378244.864316:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81484800/0xdd3c5462d7852c9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d4e expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378244.864329:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378244.864361:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a49b169-b438-4a59-90b0-00ee704ad017+11:2354:x1874201604626176:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1085us (9461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378244.864368:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1787378244.867750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378244.868100:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604626304 00000100:00100000:2.0:1787378244.868114:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604626304 00000100:00100000:2.0:1787378244.868210:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1787378244.868222:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a49b169-b438-4a59-90b0-00ee704ad017+11:2354:x1874201604626304:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378244.868246:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378244.868275:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128b000/0xdd3c5462d7852c03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d16 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378244.868322:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378244.868551:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a49b169-b438-4a59-90b0-00ee704ad017+10:2354:x1874201604626304:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 328us (13363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378244.868560:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1787378244.869257:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604626816 00000100:00100000:0.0:1787378244.869266:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604626816 00000100:00100000:0.0:1787378244.869325:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:0.0:1787378244.869345:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+7:2352:x1874201604626816:12345-192.168.203.22@tcp:9:umount.0 00000020:00000080:0.0:1787378244.869380:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d78531dd 00000020:00010000:0.0:1787378244.869388:0:6589:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9eebbb3c0000: total 0 00000100:00080000:0.0:1787378244.869394:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9eebbb3c4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787378244.869444:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787378244.869781:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2352:x1874201604626816:12345-192.168.203.22@tcp:9:umount.0 Request processed in 447us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378244.869789:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000020:00010000:0.0:1787378244.869812:0:5780:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9eebbb3c0000: total 0 00010000:00010000:0.0:1787378244.869834:0:5780:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9eebbb3c0000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787378244.869898:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dcc7c15/0xdd3c5462d7853c17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71bc expref: 4 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378244.869966:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4eaa0d7/0xdd3c5462d7853579 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fee expref: 3 pid: 8120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378244.869984:0:5780:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9eebbb3c0000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787378244.869997:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378244.869999:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378244.870001:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787378244.870015:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787378244.877626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378244.877760:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604626944 00000100:00100000:0.0:1787378244.877774:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604626944 00000100:00100000:0.0:1787378244.877864:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:0.0:1787378244.877877:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+5:2352:x1874201604626944:12345-192.168.203.22@tcp:9:umount.0 00000020:00000080:0.0:1787378244.877916:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852f75 00000100:00080000:0.0:1787378244.877927:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eeb8761c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787378244.877985:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1787378244.878314:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787378244.878458:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787378244.880485:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+2:2352:x1874201604626944:12345-192.168.203.22@tcp:9:umount.0 Request processed in 2596us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378244.880503:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:2.0:1787378244.887706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378244.888181:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604627968 00000100:00100000:0.0:1787378244.888199:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604627968 00000100:00100000:0.0:1787378244.888355:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:0.0:1787378244.888367:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+22:2352:x1874201604627968:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:0.0:1787378244.888417:0:9982:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852c11 00000020:00010000:0.0:1787378244.888439:0:9982:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9eea821c2000: total 0 00000100:00080000:0.0:1787378244.888445:0:9982:0:(import.c:65:import_set_state_nolock()) ffff9eebad27f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787378244.888499:0:9982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1787378244.888553:0:6602:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9eea821c2000: total 0 00010000:00010000:3.0:1787378244.888624:0:6602:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9eea821c2000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787378244.888675:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:3.0:1787378244.888681:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378244.888694:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7853bd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71a7 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.888771:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:3.0:1787378244.888789:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378244.888797:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1200/0xdd3c5462d78535db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a700a expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.888821:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb97cb4400) 00010000:00010000:3.0:1787378244.888824:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378244.888831:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05600/0xdd3c5462d7852ef7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e2e expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.888856:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378244.888859:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787378244.888864:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d785353a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fd9 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.888882:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:3.0:1787378244.888886:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787378244.888892:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d7853c02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71b5 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.888906:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eeb97cb4900) 00010000:00010000:3.0:1787378244.888909:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378244.888913:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04800/0xdd3c5462d7852edb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e27 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.888947:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378244.888951:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787378244.888956:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05a00/0xdd3c5462d7853564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fe7 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.888989:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:3.0:1787378244.888992:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787378244.888998:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547e00/0xdd3c5462d78538d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a70e3 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.889016:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378244.889019:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787378244.889026:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7852f4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e43 expref: 15 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.889042:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eeb829cd600) 00010000:00010000:3.0:1787378244.889047:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787378244.889051:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc0a00/0xdd3c5462d7853af8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a716f expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.889085:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eeb829cd100) 00010000:00010000:3.0:1787378244.889088:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787378244.889092:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7853238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6f15 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378244.889170:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ca7eed4-13a1-4f52-9d12-97b20fe7905e+11:2352:x1874201604627968:12345-192.168.203.22@tcp:39:umount.0 Request processed in 802us (1471us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787378244.889181:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 240 00010000:00010000:3.0:1787378244.889531:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eeb85524200) 00010000:00010000:3.0:1787378244.889534:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787378244.889539:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb81547200/0xdd3c5462d78535f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7011 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.889555:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eeb97cb4200) 00010000:00010000:3.0:1787378244.889557:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787378244.889569:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1e00/0xdd3c5462d785345a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6fa1 expref: 8 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378244.889583:0:6602:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9eea821c2000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787378244.889602:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378244.889604:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378244.889606:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787378244.954050:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787378244.954061:0:11535:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787378244.954587:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787378244.954595:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:2.0:1787378245.229463:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:2.0:1787378245.229472:0:7491:0:(genops.c:906:class_export_put()) final put ffff9eebbb3c0000/3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:1.0:1787378245.229541:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbb3c0000/3ca7eed4-13a1-4f52-9d12-97b20fe7905e for lustre-OST0001 00000020:00000080:1.0:1787378245.229585:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eebbb3c4000 for lustre-OST0001 00010000:00010000:0.0:1787378245.594552:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378246.269002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378246.269054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378246.269222:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604628224 00000100:00100000:3.0:1787378246.269241:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604628224 00000100:00100000:3.0:1787378246.269326:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:3.0:1787378246.269337:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2353:x1874201604628224:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378246.269411:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2353:x1874201604628224:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 77us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378246.269419:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:1.0:1787378246.269472:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604628096 00000100:00100000:1.0:1787378246.269476:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604628096 00000100:00100000:1.0:1787378246.269516:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00100000:1.0:1787378246.269523:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:2353:x1874201604628096:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378246.269552:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a49b169-b438-4a59-90b0-00ee704ad017+10:2353:x1874201604628096:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378246.269558:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00080000:0.0:1787378246.270038:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787378246.618466:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787378246.763908:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:2.0:1787378246.763917:0:6613:0:(genops.c:906:class_export_put()) final put ffff9eeb8761b000/3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:1.0:1787378246.763996:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb8761b000/3ca7eed4-13a1-4f52-9d12-97b20fe7905e for lustre-OST0000 00000020:00000080:1.0:1787378246.764046:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb8761c000 for lustre-OST0000 00000100:00100000:3.0:1787378246.769605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378246.769716:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604628352 00000100:00100000:2.0:1787378246.769759:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604628352 00000100:00100000:2.0:1787378246.769816:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1787378246.769825:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+10:2353:x1874201604628352:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378246.769842:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378246.769863:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6200/0xdd3c5462d7852ce3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d63 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378246.769882:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378246.769952:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a49b169-b438-4a59-90b0-00ee704ad017+9:2353:x1874201604628352:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 127us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378246.769960:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1787378246.774914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378246.775055:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604628480 00000100:00100000:1.0:1787378246.775064:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604628480 00000100:00100000:1.0:1787378246.775168:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1787378246.775178:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8a3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a49b169-b438-4a59-90b0-00ee704ad017+9:2354:x1874201604628480:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378246.775206:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378246.775225:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6e00/0xdd3c5462d7852cea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d8d expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378246.775244:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378246.775306:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8a3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a49b169-b438-4a59-90b0-00ee704ad017+8:2354:x1874201604628480:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 130us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378246.775313:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1787378246.777835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378246.777942:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604628608 00000100:00100000:2.0:1787378246.777959:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604628608 00000100:00100000:2.0:1787378246.778047:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1787378246.778056:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb720e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a49b169-b438-4a59-90b0-00ee704ad017+8:2354:x1874201604628608:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378246.778071:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378246.778088:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128a400/0xdd3c5462d7852eaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6e12 expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378246.778104:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378246.778174:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb720e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a49b169-b438-4a59-90b0-00ee704ad017+7:2354:x1874201604628608:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 119us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378246.778185:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1787378246.791618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378246.791786:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604628864 00000100:00100000:2.0:1787378246.791801:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604628864 00000100:00100000:2.0:1787378246.791866:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:2.0:1787378246.791876:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+6:2352:x1874201604628864:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:2.0:1787378246.791929:0:5792:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852cf8 00000020:00010000:2.0:1787378246.791939:0:5792:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9eeb8835e000: total 0 00000100:00080000:2.0:1787378246.791943:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9eeb8835c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787378246.791979:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1787378246.792085:0:6602:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9eeb8835e000: total 0 00010000:00010000:3.0:1787378246.792093:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378246.792257:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1984c41f-3b43-4d7f-8b57-f1444ac920d9+5:2352:x1874201604628864:12345-192.168.203.22@tcp:39:umount.0 Request processed in 380us (653us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1787378246.792267:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 241 00010000:00010000:3.0:1787378246.792435:0:6602:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9eeb8835e000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787378246.792490:0:6602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeba261ea00) 00010000:00010000:3.0:1787378246.792495:0:6602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378246.792507:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d7853c25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71c3 expref: 4 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378246.792565:0:6602:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9eeb8835e000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787378246.793581:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378246.793589:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378246.793592:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378246.815783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378246.815857:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604629120 00000100:00100000:1.0:1787378246.815870:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604629120 00000100:00100000:1.0:1787378246.816049:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 306 00000100:00100000:1.0:1787378246.816062:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+7:2352:x1874201604629120:12345-192.168.203.22@tcp:251:umount.0 00000020:00000080:1.0:1787378246.816112:0:5783:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852bee 00000020:00010000:1.0:1787378246.816132:0:5783:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9eea821c1800: total 0 00000100:00080000:1.0:1787378246.816138:0:5783:0:(import.c:65:import_set_state_nolock()) ffff9eea821c0800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787378246.816198:0:5780:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9eea821c1800: total 0 00000100:00100000:1.0:1787378246.816224:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a49b169-b438-4a59-90b0-00ee704ad017+3:2352:x1874201604629120:12345-192.168.203.22@tcp:251:umount.0 Request processed in 162us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378246.816234:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 306 00010000:00010000:0.0:1787378246.816465:0:5780:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9eea821c1800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787378246.816515:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d7852ca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a6d55 expref: 2 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378246.816536:0:5780:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9eea821c1800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787378246.816547:0:5780:0:(genops.c:906:class_export_put()) final put ffff9eea821c1800/7a49b169-b438-4a59-90b0-00ee704ad017 00010000:00010000:0.0:1787378246.816572:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378246.816575:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378246.816576:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787378246.817335:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eea821c1800/7a49b169-b438-4a59-90b0-00ee704ad017 for MGS 00000020:00000080:3.0:1787378246.817398:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eea821c0800 for MGS 00010000:00010000:3.0:1787378247.643479:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378248.665962:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378248.731585:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626627456:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.731989:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.732055:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626627968:0@lo:400:kworker.0 00000100:00100000:1.0:1787378248.732071:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626627456 00000100:00100000:1.0:1787378248.732081:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626627456 00000100:00100000:2.0:1787378248.732087:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.732117:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787378248.732133:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626627840:0@lo:400:kworker.0 00000100:00100000:1.0:1787378248.732146:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787378248.732156:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626627456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.732160:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.732192:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626627584:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.732218:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378248.732219:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb88372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3314:x1874201626627456:12345-0@lo:400:kworker.0 Request processed in 64us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378248.732227:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787378248.732233:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626628096:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.732252:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.732269:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378248.732275:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626627712:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.732298:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.732340:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626627968 00000100:00100000:2.0:1787378248.732344:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626627968 00000100:00100000:1.0:1787378248.732364:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626627584 00000100:00100000:1.0:1787378248.732374:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626627584 00000100:00100000:2.0:1787378248.732386:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626627712 00000100:00100000:2.0:1787378248.732388:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626627712 00000100:00100000:1.0:1787378248.732390:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787378248.732396:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626627968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.732403:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787378248.732407:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626627584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378248.732431:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626627968:12345-0@lo:400:kworker.0 Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378248.732438:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787378248.732453:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787378248.732455:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626627584:12345-0@lo:400:kworker.0 Request processed in 48us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378248.732464:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787378248.732467:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626627712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378248.732494:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626627712:12345-0@lo:400:kworker.0 Request processed in 27us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378248.732500:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787378248.732689:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626627840 00000100:00100000:2.0:1787378248.732694:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626627840 00000100:00100000:2.0:1787378248.732753:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626628096 00000100:00100000:2.0:1787378248.732757:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626628096 00000100:00100000:2.0:1787378248.732781:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787378248.732787:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626627840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.732819:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626627840:12345-0@lo:400:kworker.0 Request processed in 32us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378248.732825:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787378248.733140:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787378248.733148:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626628096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.733182:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626628096:12345-0@lo:400:kworker.0 Request processed in 35us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378248.733188:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1787378248.733218:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787378248.733223:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378248.733225:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378248.733270:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626627712:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.733282:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626627584:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.733291:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626628096:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.733337:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626627840:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.733347:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3314:1874201626627456:0@lo:400:kworker.0 00000100:00100000:2.0:1787378248.733356:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626627968:0@lo:400:kworker.0 00000020:01000004:0.0:1787378248.736833:0:12867:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787378248.753382:0:12867:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787378248.753446:0:12867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.753462:0:12867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.753472:0:12867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.753480:0:12867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.753522:0:12867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787378248.753529:0:12867:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787378248.753557:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787378248.753563:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787378248.753571:0:12867:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787378248.753601:0:12867:0:(import.c:65:import_set_state_nolock()) ffff9eeb86306800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787378248.755663:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378248.755679:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.755694:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ba00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378248.755698:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.755711:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378248.755754:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378248.755761:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787378248.755764:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787378248.755768:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787378248.755819:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.755825:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787378248.756571:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.756598:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ba00/0xdd3c5462d7852c73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c7a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.756614:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378248.756616:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378248.756618:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378248.756638:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626628224:0@lo:39:umount.0 00000100:00100000:3.0:1787378248.756746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.758731:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626628352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378248.758819:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.758917:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626628352 00000100:00100000:2.0:1787378248.758927:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626628352 00000100:00100000:2.0:1787378248.758998:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787378248.759008:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3312:x1874201626628352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378248.759027:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378248.759052:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd05200/0xdd3c5462d7852c7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852c73 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378248.759092:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378248.759137:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:3312:x1874201626628352:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378248.759146:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787378248.759196:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626628352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378248.759224:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626628224 00000100:00100000:2.0:1787378248.759228:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626628224 00000100:00100000:2.0:1787378248.759258:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787378248.759265:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874201626628224:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787378248.759299:0:5790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d78529fd 00000100:00080000:2.0:1787378248.759310:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9eeb9a29d000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787378248.759374:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1874201626628224:12345-0@lo:39:umount.0 Request processed in 109us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378248.759380:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787378248.759387:0:5790:0:(genops.c:906:class_export_put()) final put ffff9eeb89d20000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787378248.759411:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787378248.760238:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb89d20000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787378248.760311:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb9a29d000 for lustre-MDT0000 00000100:00080000:2.0:1787378248.765957:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eeb86306800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787378248.766062:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626628224:0@lo:39:umount.0 00000100:00080000:0.0:1787378248.766100:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787378248.766106:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787378248.766113:0:12867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787378248.768923:0:12867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.768947:0:12867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.768956:0:12867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.768963:0:12867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.768996:0:12867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378248.769004:0:12867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.769011:0:12867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.769041:0:12867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.769048:0:12867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.769121:0:12867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787378248.769131:0:12867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.769138:0:12867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.769145:0:12867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.769151:0:12867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770325:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787378248.770340:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770353:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484a00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378248.770358:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770369:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378248.770377:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378248.770384:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787378248.770387:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787378248.770449:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770456:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787378248.770652:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626628480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378248.770763:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787378248.770869:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770878:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81484a00/0xdd3c5462d7852c81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770898:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787378248.770903:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770920:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81546a00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378248.770923:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770930:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378248.770935:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378248.770941:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787378248.770944:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787378248.770948:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787378248.770965:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.770972:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787378248.771207:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378248.771217:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626628608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378248.771248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787378248.771252:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378248.771262:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378248.771272:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebc21c7000 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378248.771276:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378248.771284:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378248.771291:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378248.771293:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626628480 10000000:01000000:1.0:1787378248.771300:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787378248.771303:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626628480 10000000:01000000:1.0:1787378248.771317:0:6602:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787378248.771341:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378248.771347:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787378248.771357:0:8358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626628608 00000100:00100000:2.0:1787378248.771360:0:8358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626628608 00010000:00010000:1.0:1787378248.771370:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378248.771380:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378248.771381:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787378248.771385:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378248.771389:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378248.771390:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+19:3313:x1874201626628480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378248.771404:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378248.771419:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04a00/0xdd3c5462d7852c88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852c81 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378248.771430:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787378248.771542:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.771549:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81546a00/0xdd3c5462d7852ba8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852baf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378248.771576:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378248.771578:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378248.771580:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378248.771608:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+18:3313:x1874201626628480:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378248.771618:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787378248.771639:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787378248.771645:0:8358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+17:3313:x1874201626628608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378248.771654:0:8358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378248.771665:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128b200/0xdd3c5462d7852baf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852ba8 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378248.771677:0:8358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378248.771700:0:8358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3313:x1874201626628608:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378248.771707:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787378248.771751:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378248.771758:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787378248.771767:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626628736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378248.771788:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.771811:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626628736 00000100:00100000:2.0:1787378248.771814:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626628736 00000100:00100000:2.0:1787378248.771847:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787378248.771853:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae277100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+16:3312:x1874201626628736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378248.771861:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378248.771871:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128b400/0xdd3c5462d7852ea3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852e9c expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378248.771878:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378248.771898:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae277100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:3312:x1874201626628736:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378248.771902:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787378248.771951:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626628736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378248.772481:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626628608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378248.772492:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626628480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378248.775089:0:12867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787378248.775111:0:12867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebc21c7000/0xdd3c5462d7852e9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852ea3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378248.775135:0:12867:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787378248.775156:0:12867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.775166:0:12867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.775204:0:12867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.775212:0:12867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378248.775240:0:12867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787378248.775245:0:12867:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787378248.775249:0:12867:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787378248.775299:0:12867:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787378248.775305:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787378248.775311:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787378248.775319:0:12867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1787378248.775327:0:12867:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9eeb87699800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787378248.775334:0:12867:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9eebbf743800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787378248.775344:0:12867:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9eeb8835e000 1984c41f-3b43-4d7f-8b57-f1444ac920d9 192.168.203.22@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787378248.775350:0:12867:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9eea821c2000 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 192.168.203.22@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00010000:00010000:1.0:1787378248.775355:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:0.0:1787378248.775357:0:12867:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9eeb876519c0) has exports, disconnecting them 00000020:00080000:0.0:1787378248.775366:0:12867:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eeb87699800), last request at 1787378248 00010000:00010000:1.0:1787378248.775367:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787378248.775377:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852b70 00010000:00010000:1.0:1787378248.775378:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81547600 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378248.775384:0:6602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378248.775394:0:6602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378248.775402:0:6602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378248.775409:0:6602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00080000:0.0:1787378248.775409:0:12867:0:(import.c:65:import_set_state_nolock()) ffff9eeb87698800 : changing import state from FULL to CLOSED 10000000:01000000:1.0:1787378248.775415:0:6602:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787378248.775419:0:6602:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787378248.775478:0:6602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378248.775487:0:6602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787378248.775498:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378248.775525:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378248.775535:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81547600/0xdd3c5462d785295c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852963 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378248.775536:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626628864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378248.775564:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378248.775567:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378248.775569:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378248.775636:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378248.775859:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626628864 00000100:00100000:1.0:1787378248.775869:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626628864 00000100:00100000:1.0:1787378248.775948:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787378248.775959:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+15:3312:x1874201626628864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378248.775979:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378248.775998:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81485e00/0xdd3c5462d7852963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d785295c expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378248.776017:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378248.776078:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6+14:3312:x1874201626628864:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378248.776087:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787378248.776167:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626628864:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787378248.776288:0:12867:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eeb87699800): rc 0 00000020:00000080:0.0:1787378248.776292:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb87699800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787378248.776312:0:12867:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eebbf743800), last request at 1787378248 00000020:00000080:0.0:1787378248.776316:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852aa5 00000100:00080000:0.0:1787378248.776322:0:12867:0:(import.c:65:import_set_state_nolock()) ffff9eebbf746000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787378248.776345:0:12867:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eebbf743800): rc 0 00000020:00000080:0.0:1787378248.776347:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebbf743800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787378248.776356:0:12867:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb59a01defae0 00010000:00010000:2.0:1787378248.776366:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787378248.776378:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb87699800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1787378248.776380:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787378248.776385:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787378248.776405:0:12867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1787378248.776442:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbf743800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787378248.776488:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb87698800 for lustre-MDT0000 00000020:00000080:1.0:1787378248.776493:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eebbf746000 for lustre-MDT0000 00000100:00080000:0.0:1787378248.776586:0:12867:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787378248.776606:0:12867:0:(import.c:65:import_set_state_nolock()) ffff9eeb87682000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787378248.776629:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787378248.776632:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787378248.776648:0:12867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787378248.776709:0:12867:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787378248.776738:0:12867:0:(import.c:65:import_set_state_nolock()) ffff9eebad27e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787378248.776765:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9eeb876519c0) has no exports 00000100:00100000:2.0:1787378248.776835:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626628992:0@lo:9:umount.0 00000100:00100000:2.0:1787378248.776885:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378248.776930:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626629120:0@lo:9:umount.0 00000100:00100000:2.0:1787378248.776957:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378248.777126:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626628992 00000100:00100000:0.0:1787378248.777132:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626628992 00000100:00100000:0.0:1787378248.777240:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626629120 00000100:00100000:0.0:1787378248.777244:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626629120 00000100:00100000:3.0:1787378248.777435:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787378248.777447:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874201626628992:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787378248.777485:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852af2 00000100:00080000:3.0:1787378248.777495:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eebbf7bb000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787378248.777541:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787378248.777549:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787378248.778039:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1874201626628992:12345-0@lo:9:umount.0 Request processed in 593us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378248.778049:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787378248.778076:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787378248.778085:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874201626629120:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787378248.778115:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852be7 00000100:00080000:3.0:1787378248.778123:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9eea821c6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787378248.778160:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787378248.778374:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1874201626629120:12345-0@lo:9:umount.0 Request processed in 290us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378248.778380:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1787378248.778404:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787378248.782892:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eeb87682000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787378248.782943:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787378248.782945:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787378248.782954:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626628992:0@lo:9:umount.0 00000100:00080000:1.0:1787378248.782972:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebad27e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787378248.782982:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787378248.782983:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787378248.782986:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626629120:0@lo:9:umount.0 00000020:00080000:0.0:1787378248.789198:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9eeb876519c0) has no exports 00000020:00000080:0.0:1787378248.858270:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d78529b7 00000020:00000080:0.0:1787378248.858291:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebb4f7c000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787378248.858383:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787378248.858663:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebb4f7c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787378248.858697:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787378248.858709:0:12867:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787378248.858715:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9eeb88278000) has no exports 00000020:00000080:0.0:1787378248.862311:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d78529b0 00000020:00000080:0.0:1787378248.862330:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebbc249000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787378248.862404:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbc249000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787378248.862563:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787378248.862578:0:12867:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787378248.862582:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebbc248800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787378248.862939:0:12867:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbc248800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787378248.862946:0:12867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1787378249.690088:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787378249.839534:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000001:00080000:3.0:1787378249.839560:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:3.0:1787378249.839582:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1984c41f-3b43-4d7f-8b57-f1444ac920d9 00000001:00080000:3.0:1787378249.839588:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1787378249.839592:0:5812:0:(genops.c:906:class_export_put()) final put ffff9eeb8835e000/1984c41f-3b43-4d7f-8b57-f1444ac920d9 00000020:00000080:3.0:1787378249.839619:0:5812:0:(genops.c:906:class_export_put()) final put ffff9eea821c2000/3ca7eed4-13a1-4f52-9d12-97b20fe7905e 00000020:00000080:0.0:1787378249.843686:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb8835e000/1984c41f-3b43-4d7f-8b57-f1444ac920d9 for lustre-MDT0000 00000020:00000080:0.0:1787378249.844010:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eea821c2000/3ca7eed4-13a1-4f52-9d12-97b20fe7905e for lustre-MDT0000 00000020:00000080:0.0:1787378249.844095:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb8835c000 for lustre-MDT0000 00000020:00000080:0.0:1787378249.844101:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eebad27f800 for lustre-MDT0000 00000001:00100000:3.0:1787378250.295743:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787378250.295754:0:7491:0:(genops.c:906:class_export_put()) final put ffff9eea821c3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787378250.295878:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eea821c3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787378250.295948:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eea821c6000 for lustre-OST0001 00010000:00010000:1.0:1787378250.714949:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787378250.905984:0:12867:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9eea82427d80 - data ffff9eebbfc15000/ffff9eebbb279400 00000020:01000000:0.0:1787378250.906158:0:12867:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9eeb8660f240 - data ffff9eebb0ba6af8/ffff9eeb8832d800 00000001:00000004:0.0:1787378250.913355:0:12867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1787378251.009564:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787378251.009575:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787378251.009603:0:12867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787378251.009607:0:12867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787378251.010457:0:6892:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787378251.010464:0:6892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787378251.010486:0:6892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787378251.013425:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787378251.013436:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787378251.013463:0:12867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787378251.013510:0:12867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787378251.015241:0:7944:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787378251.015251:0:7944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787378251.015267:0:7944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787378251.084584:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d785297f 00000020:00000080:3.0:1787378251.084600:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb9a29c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787378251.085782:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb9a29c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787378251.087137:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852994 00000020:00000080:3.0:1787378251.087272:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebae99d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787378251.087329:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787378251.087339:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378251.087351:0:12867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787378251.087355:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9eeb87653380) has no exports 00000004:01000000:3.0:1787378251.087556:0:12867:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787378251.087566:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852bd2 00000020:00000080:3.0:1787378251.087571:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eea821c0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787378251.087915:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787378251.087927:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378251.087936:0:12867:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787378251.087939:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9eebb5383380) has no exports 00000020:00000080:3.0:1787378251.087952:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852bcb 00000020:00000080:3.0:1787378251.087961:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebad278800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787378251.088361:0:12867:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787378251.088367:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787378251.088372:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787378251.088379:0:12867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787378251.088382:0:12867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787378251.088433:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787378251.088440:0:12867:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787378251.088447:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852aeb 00000020:00000080:3.0:1787378251.088451:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebbf7bb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787378251.088455:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787378251.088459:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378251.088462:0:12867:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787378251.088464:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9eeb87794d40) has no exports 00000020:00000080:3.0:1787378251.088468:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852ae4 00000020:00000080:3.0:1787378251.088471:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebbf7be800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787378251.089124:0:12867:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787378251.089128:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787378251.089132:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787378251.089136:0:12867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787378251.089137:0:12867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787378251.089254:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787378251.089260:0:12867:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787378251.089294:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787378251.089296:0:12867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787378251.089328:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d785299b 00000020:00000080:3.0:1787378251.089333:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebae999800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787378251.089339:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787378251.089343:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378251.089347:0:12867:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787378251.089349:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9eeb87650000) has no exports 00000020:00000080:3.0:1787378251.089368:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787378251.089371:0:12867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787378251.089374:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d78529a2 00000020:00000080:3.0:1787378251.089378:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebae998800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787378251.089387:0:12867:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eeb8a31b800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787378251.089390:0:12867:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eeb8a31b800 3 00000020:01000004:3.0:1787378251.089393:0:12867:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eeb8a31b800 from lustre-MDT0000 00000020:00000080:3.0:1787378251.089416:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787378251.089427:0:12867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787378251.089430:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb9a29f000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787378251.089434:0:12867:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb9a29f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787378251.089443:0:12867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787378251.089524:0:12867:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787378251.089528:0:12867:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787378251.089531:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787378251.089533:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378251.089536:0:12867:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787378251.089543:0:12867:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9eeb89986800 fcf23d9b-e184-4291-9fe7-ec0ed8a185e6 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787378251.089549:0:12867:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9eeb883b0000) has exports, disconnecting them 00000020:00080000:3.0:1787378251.089554:0:12867:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9eeb89986800), last request at 1787378022 00000020:00000080:3.0:1787378251.089571:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852940 00000020:00010000:3.0:1787378251.089575:0:12867:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9eeb89986800: total 7 00000100:00080000:3.0:1787378251.089579:0:12867:0:(import.c:65:import_set_state_nolock()) ffff9eeb89983000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787378251.089602:0:12867:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eeb89986800): rc 0 00000020:00080000:3.0:1787378251.089606:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9eeb883b0000) has no exports 00000020:00010000:3.0:1787378251.089628:0:6602:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9eeb89986800: total 7 00010000:00010000:3.0:1787378251.089909:0:6602:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9eeb89986800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787378251.089997:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04e00/0xdd3c5462d7852c5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852c57 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378251.090015:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c7400/0xdd3c5462d7852c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852c49 expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378251.090027:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c6c00/0xdd3c5462d7852e87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852e80 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378251.090038:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c7e00/0xdd3c5462d7852c6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852c65 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378251.090060:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81484c00/0xdd3c5462d7852c96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852c8f expref: 5 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378251.090071:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb81546800/0xdd3c5462d7852e95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852e8e expref: 4 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378251.090086:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c7800/0xdd3c5462d7852a58 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852a51 expref: 3 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378251.090097:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebc21c7a00/0xdd3c5462d7852c42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd3c5462d7852c3b expref: 2 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378251.090107:0:6602:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9eeb89986800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787378251.090117:0:6602:0:(genops.c:906:class_export_put()) final put ffff9eeb89986800/fcf23d9b-e184-4291-9fe7-ec0ed8a185e6 00010000:00010000:3.0:1787378251.090134:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378251.090136:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378251.090138:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787378251.090371:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebae99d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787378251.090379:0:37:0:(genops.c:906:class_export_put()) final put ffff9eeb89d20800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787378251.090381:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb89d20800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787378251.090391:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787378251.090524:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eea821c0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787378251.090530:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebad278800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787378251.090535:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eebad27e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787378251.090540:0:37:0:(genops.c:906:class_export_put()) final put ffff9eebad27f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787378251.090542:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebad27f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787378251.090545:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787378251.090580:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbf7bb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787378251.090585:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbf7be800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787378251.090590:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb87682000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787378251.090594:0:37:0:(genops.c:906:class_export_put()) final put ffff9eebbf7be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787378251.090596:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbf7be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787378251.090599:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:3.0:1787378251.090976:0:5786:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9eeb882f8800:5786] 2 exiting: rc = 0 00000020:00000080:1.0:1787378251.091034:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebae999800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787378251.091039:0:37:0:(genops.c:906:class_export_put()) final put ffff9eeb89d26000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787378251.091041:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb89d26000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787378251.091044:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787378251.091210:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebae998800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787378251.091216:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb89986800/fcf23d9b-e184-4291-9fe7-ec0ed8a185e6 for MGS 00000020:00000080:1.0:1787378251.091251:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb89983000 for MGS 00000100:00100000:1.0:1787378251.091271:0:5783:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9eeb8a396e00:5783] 0 exiting: rc = 1 00000100:00100000:1.0:1787378251.091495:0:5785:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9eeb8a397800:5785] 1 exiting: rc = 0 00000100:00100000:0.0:1787378251.091581:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.091591:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.091596:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.091603:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.091611:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.091618:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.091624:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.091631:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.091639:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092008:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092019:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092025:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092036:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092043:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092048:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092053:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092060:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092066:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092072:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092079:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092084:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092090:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092095:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092100:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092118:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092124:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092130:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092135:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092141:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092208:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092216:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092221:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092226:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092231:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092237:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092242:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092247:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092254:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092267:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092318:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092327:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092333:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092339:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092344:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092350:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092355:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092361:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092368:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092374:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092380:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092387:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092393:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092399:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092404:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092410:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092417:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092423:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092431:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092437:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092452:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092457:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092463:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092469:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.092474:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787378251.093529:0:12867:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787378251.093535:0:12867:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787378251.098500:0:12867:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9eeb905f8900 - data ffff9eebbfc04af8/ffff9eebb53d2c00 00000020:01000000:1.0:1787378251.099096:0:12867:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9eeb97cdff60 - data ffff9eebb098b288/ffff9eeb8442c000 00000020:00000080:1.0:1787378251.100347:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852924 00000020:00000080:1.0:1787378251.100358:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb883bf000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787378251.100421:0:12867:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eeb8a31b800 from MGS, refs=2 00000020:01000004:1.0:1787378251.100426:0:12867:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eeb8a31b800 2 00000020:01000004:1.0:1787378251.100430:0:12867:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eeb8a31b800 from MGS 00000020:00000080:1.0:1787378251.100456:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787378251.100466:0:12867:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787378251.100469:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb86520000/MGS 00000020:00000080:1.0:1787378251.100472:0:12867:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb86520000/MGS for MGS 00000020:01000000:1.0:1787378251.100480:0:12867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787378251.100547:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787378251.100563:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787378251.100570:0:12867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787378251.100578:0:12867:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9eeb86305000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787378251.100585:0:12867:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9eeb87793380) has exports, disconnecting them 00000020:00080000:1.0:1787378251.100590:0:12867:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9eeb86305000), last request at 1787378023 00000020:00000080:1.0:1787378251.100595:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d78529ef 00000020:00080000:1.0:1787378251.100607:0:12867:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eeb86305000): rc 0 00000020:00000080:1.0:1787378251.100611:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb86305000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787378251.100638:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb883bf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787378251.101127:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb86305000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787378251.106881:0:12867:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787378251.106910:0:12867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787378251.106916:0:12867:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787378251.107001:0:12867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787378251.107274:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb86306800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787378251.108076:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787378251.108091:0:12867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787378251.108097:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eebadeca000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787378251.108102:0:12867:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebadeca000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787378251.108111:0:12867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787378251.108598:0:12867:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eeb8a31b800 1 00000020:00000080:1.0:1787378251.108607:0:12867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852916 00000020:00000080:1.0:1787378251.108615:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb86522000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787378251.108631:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787378251.108636:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378251.108764:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb86522000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787378251.108879:0:12867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787378251.108885:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9eeb87654d40) has no exports 00000020:00000080:0.0:1787378251.172436:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787378251.172459:0:12867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787378251.172467:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb8a31a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787378251.172473:0:12867:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb8a31a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787378251.172482:0:12867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787378251.172660:0:12867:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eeb8a31c000 00000020:01000000:0.0:1787378251.172693:0:12867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787378251.172698:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787378251.172704:0:12867:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787378251.172708:0:12867:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9eeb883b4d40) has no exports 00000100:00100000:2.0:1787378251.173045:0:5791:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9eeb9a2a0200:5791] 1 exiting: rc = 0 00000100:00100000:2.0:1787378251.173177:0:9982:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9eeb8a244200:9982] 3 exiting: rc = 0 00000100:00100000:2.0:1787378251.173276:0:5790:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9eeb9a2a1a00:5790] 0 exiting: rc = 1 00000100:00100000:2.0:1787378251.173353:0:5792:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9eeb9a2a0600:5792] 2 exiting: rc = 0 00000100:00100000:0.0:1787378251.173824:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173835:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173846:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173854:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173861:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173868:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173876:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173883:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173903:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173910:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173917:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173923:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173929:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173935:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173942:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173949:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173972:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173978:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173986:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.173993:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174000:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174005:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174012:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174018:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174024:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174031:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174038:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174046:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174053:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174059:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174066:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174074:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174081:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174088:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174095:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174101:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174120:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174125:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174131:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174137:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174143:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174156:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174162:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174169:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174175:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174182:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174190:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174196:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174203:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174209:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174216:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174231:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174239:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174250:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174257:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174263:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174270:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174276:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174282:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174288:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174294:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174301:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174307:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.174313:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.181113:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9eeb9a2a0e00:5794] 1 exiting: rc = 0 00000100:00100000:1.0:1787378251.181272:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9eeb9a2a1000:5793] 0 exiting: rc = 1 00000100:00100000:0.0:1787378251.182385:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182397:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182404:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182412:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182418:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182424:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182430:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182437:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182443:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182449:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182456:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182464:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182473:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182477:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182482:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182487:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182493:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182499:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182504:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182509:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182514:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182539:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182545:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182550:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182556:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182562:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182568:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182574:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182579:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182585:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182591:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182597:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182603:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182609:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182616:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182621:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182627:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182633:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182639:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182644:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182650:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182655:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182661:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182666:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182672:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182676:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182682:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182688:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182696:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182703:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182708:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182713:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182735:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182742:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182748:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182754:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182767:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182773:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182778:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182784:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182790:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182795:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182801:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.182807:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.183855:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9eeb87639a00:5796] 1 exiting: rc = 0 00000100:00100000:2.0:1787378251.184335:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9eeb90c86400:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1787378251.185744:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185758:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185764:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185773:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185780:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185787:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185793:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185800:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185806:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185823:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185830:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185836:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185842:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185852:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185858:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185864:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185870:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185881:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185887:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185904:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185911:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185933:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185940:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185947:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185954:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185961:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185980:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185986:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.185993:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186000:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186008:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186016:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186024:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186056:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186069:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186081:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186093:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186104:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186115:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186126:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186135:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186479:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186589:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186599:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186606:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186630:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186639:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186647:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186657:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186668:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186678:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186688:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186698:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186709:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186737:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186748:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186758:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186786:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186795:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186801:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186808:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186825:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186831:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.186839:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378251.197384:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9eeb87638600:5797] 0 exiting: rc = 1 00000100:00100000:3.0:1787378251.197500:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9eeb87639600:5798] 1 exiting: rc = 0 00000100:00100000:0.0:1787378251.197609:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197619:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197625:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197631:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197636:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197643:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197648:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197653:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197659:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197663:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197669:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197674:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197680:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197685:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197691:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197697:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197702:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197708:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197713:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197745:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197751:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197756:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197761:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197766:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197771:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197777:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197783:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197788:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197794:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197799:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197804:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197809:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197833:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197840:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197845:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197852:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197858:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197863:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197869:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197876:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197881:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197887:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197902:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197908:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197914:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197920:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197926:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197931:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197937:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197943:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197949:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197955:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197961:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197966:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197972:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197979:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197984:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197990:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.197995:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.198000:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.198005:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.198010:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.198015:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.198019:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378251.198829:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9eeb9a22bc00:5800] 1 exiting: rc = 0 00000100:00100000:3.0:1787378251.198929:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9eeb9a22aa00:5799] 0 exiting: rc = 1 00000100:00100000:0.0:1787378251.199004:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199016:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199021:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199038:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199045:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199051:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199056:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199062:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199068:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199074:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199080:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199086:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199092:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199098:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199114:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199120:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199126:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199131:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199137:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199143:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199155:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199161:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199167:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199172:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199178:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199184:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199190:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199195:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199211:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199217:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199223:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199228:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199234:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199239:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199245:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199251:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199257:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199262:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199275:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199280:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199286:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199292:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199297:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199303:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199308:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199313:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199318:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199322:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199327:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199331:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199336:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199341:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199346:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199351:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199357:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199362:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199367:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199373:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199378:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199383:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199388:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199393:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199399:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199403:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.199766:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9eeb9a22a200:5802] 1 exiting: rc = 0 00000100:00100000:3.0:1787378251.199978:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9eeb9a22ba00:5801] 0 exiting: rc = 1 00000100:00100000:0.0:1787378251.200080:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200087:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200093:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200098:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200104:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200110:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200115:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200121:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200134:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200140:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200268:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200275:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200280:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200286:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200292:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200297:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200302:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200307:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200313:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200318:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200323:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200327:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200332:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200337:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200342:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200347:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200354:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200359:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200364:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200368:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200373:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200378:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200382:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200387:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200392:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200397:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200402:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200407:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200412:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200417:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200422:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200427:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200432:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200443:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200448:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200453:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200458:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200464:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200468:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200474:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200479:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200484:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200489:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200494:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200499:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200504:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200509:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200514:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200519:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200524:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200529:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200534:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200539:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.200543:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.201394:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9eebb3df6200:5803] 0 exiting: rc = 1 00000100:00100000:0.0:1787378251.201632:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9eebb3df6600:5804] 1 exiting: rc = 0 00000100:00100000:0.0:1787378251.201899:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9eebb3df7600:5805] 2 exiting: rc = 0 00000100:00100000:0.0:1787378251.201952:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.201959:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.201966:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.201972:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.201978:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.201985:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202007:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202013:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202019:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202024:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202034:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202051:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202057:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202064:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202070:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202076:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202083:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202090:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202096:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202111:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202118:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202131:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202138:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202648:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202660:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202667:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202675:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202681:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202687:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202693:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202741:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202752:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202758:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202764:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202771:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202776:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202782:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202788:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202796:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202801:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202808:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202813:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202819:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202826:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202832:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202837:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202850:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202857:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202863:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202870:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202877:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202882:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202898:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202905:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202931:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202938:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202945:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202951:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202959:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202965:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202972:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202978:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202985:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378251.202992:0:12867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787378251.208862:0:12867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787378251.208878:0:12867:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787378251.208885:0:12867:0:(genops.c:906:class_export_put()) final put ffff9eeb9a29d800/MDS_uuid 00000020:00000080:0.0:1787378251.208898:0:12867:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb9a29d800/MDS_uuid for MDS 00000020:01000000:0.0:1787378251.208905:0:12867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787378251.209070:0:12867:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787378251.737988:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787378251.865313:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787378251.865324:0:6613:0:(genops.c:906:class_export_put()) final put ffff9eebbf7ba000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787378251.865394:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbf7ba000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787378251.865454:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eebbf7bb000 for lustre-OST0000 00010000:00010000:2.0:1787378252.767181:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378253.787494:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378253.850037:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626629504:0@lo:400:kworker.0 00000400:00000100:3.0:1787378253.850109:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874201626629504 offset 0 length 224: 4 00000100:00100000:2.0:1787378253.850215:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626629248:0@lo:400:kworker.0 00000400:00000100:2.0:1787378253.850245:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874201626629248 offset 0 length 224: 4 00000100:00100000:2.0:1787378253.850310:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378253.850315:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626629376:0@lo:400:kworker.0 00000400:00000100:2.0:1787378253.850331:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874201626629376 offset 0 length 224: 4 00000020:01000004:0.0:1787378254.258834:0:13024:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787378254.275685:0:13024:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787378254.275893:0:13024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378254.275931:0:13024:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378254.275940:0:13024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378254.275948:0:13024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378254.275973:0:13024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787378254.275979:0:13024:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787378254.276009:0:13024:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787378254.276023:0:13024:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eebbb723800 x1874201626629376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378269 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787378254.276067:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378254.276076:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378254.276083:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484200 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378254.276088:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378254.276097:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378254.276106:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378254.276113:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787378254.276116:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787378254.276120:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787378254.276176:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378254.276184:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787378254.276208:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378254.276214:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81484200/0xdd3c5462d7852c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd3c5462d7852c5e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378254.276226:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378254.276228:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378254.276230:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378254.276249:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626629632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787378254.276349:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378254.276440:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626629632 00000100:00100000:3.0:1787378254.276449:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626629632 00000100:00100000:3.0:1787378254.276492:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787378254.276500:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8a3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1874201626629632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787378254.276507:0:5778:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787378254 with bad export cookie 15941709564484069696 00000100:00100000:1.0:1787378254.279879:0:13024:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787378254.279898:0:13024:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787378254.279942:0:13024:0:(import.c:65:import_set_state_nolock()) ffff9eebbf7bf000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787378254.279986:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874201626629760:0@lo:39:umount.0 00000400:00000100:1.0:1787378254.280117:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874201626629760 offset 0 length 224: 4 00000100:00100000:2.0:1787378254.280149:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626629376:0@lo:400:kworker.0 00000100:00100000:3.0:1787378254.284993:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8a3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1874201626629632:12345-0@lo:103:ldlm_bl.0 Request processed in 8476us (8628us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787378254.285012:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787378254.285268:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787378254.285276:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9eeb88277000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787378254.285280:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787378254.292761:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.122@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787378254.292769:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787378254.292782:0:3312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eebbb722300 x1874201626629248/t0(0) o400->MGC192.168.203.122@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787378269 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378254.292837:0:3312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eebbb721500 x1874201626629632/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787378270 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787378254.292848:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787378254.292852:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787378254.292854:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787378254.292858:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9eeb88277000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787378254.292864:0:3312:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 158 00000100:00080000:1.0:1787378254.292883:0:3312:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9eeb88277000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787378254.292907:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3313:1874201626629248:0@lo:400:kworker.0 00000100:00100000:1.0:1787378254.292924:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae6f9f80 x1874201626629888/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787378254.293038:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3310:1874201626629888:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1787378254.293112:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874201626629888 offset 0 length 520: 4 00000100:00100000:1.0:1787378254.293341:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3312:1874201626629632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378254.810670:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378255.836159:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378256.858330:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378257.883636:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378258.907756:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787378258.973076:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787378258.973090:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787378258.973247:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626630016:0@lo:400:kworker.0 00000400:00000100:3.0:1787378258.973320:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874201626630016 offset 0 length 224: 4 00010000:00010000:3.0:1787378259.931370:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378260.955245:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378261.980524:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378263.002168:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378264.027564:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787378264.090543:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787378264.090558:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787378264.090774:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626630144:0@lo:400:kworker.0 00000400:00000100:2.0:1787378264.090872:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874201626630144 offset 0 length 224: 4 00000100:00100000:2.0:1787378264.601920:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787378254/real 1787378254] req@ffff9eebae6f9f80 x1874201626629888/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787378264 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378264.601964:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eebae6f9f80 x1874201626629888/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787378264 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378264.601976:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787378254/real 1787378254] req@ffff9eebae6f9180 x1874201626629760/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787378264 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378264.602019:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eebae6f9180 x1874201626629760/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787378264 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787378264.602041:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eeb88277000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787378264.602122:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787378264.602126:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3310:1874201626629888:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1787378264.602133:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebbf7bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787378264.602148:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874201626629760:0@lo:39:umount.0 00000100:00080000:3.0:1787378264.603471:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787378264.603483:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787378264.603487:0:8:0:(import.c:65:import_set_state_nolock()) ffff9eeb88277000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787378264.603496:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 390 00000100:00080000:3.0:1787378264.603503:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.122@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787378264.603512:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9eeb88277000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787378264.603556:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebbb722300 x1874201626630272/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787378264.603769:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3310:1874201626630272:0@lo:250:kworker.0 00000400:00000100:2.0:1787378264.603873:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874201626630272 offset 0 length 520: 4 00000100:00080000:0.0:1787378264.608067:0:13024:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787378264.608081:0:13024:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787378264.608091:0:13024:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787378264.610710:0:13024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378264.610771:0:13024:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378264.612259:0:13024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378264.612279:0:13024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378264.612318:0:13024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378264.612332:0:13024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378264.612340:0:13024:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378264.612346:0:13024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378264.612353:0:13024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378264.612373:0:13024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787378264.612378:0:13024:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787378264.612419:0:13024:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787378264.612425:0:13024:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787378264.612432:0:13024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787378264.612439:0:13024:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787378264.612462:0:13024:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9eeb877919c0) has no exports 00000020:00080000:0.0:1787378264.612498:0:13024:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9eeb877919c0) has no exports 00010000:00010000:1.0:1787378264.613339:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787378264.613351:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378264.613363:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484000 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378264.613368:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378264.613379:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378264.613387:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378264.613412:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787378264.613415:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787378264.613419:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787378264.613439:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eeb88277000 00010000:00010000:1.0:1787378264.613443:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378264.613450:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81484000/0xdd3c5462d7852c65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852c6c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378264.613469:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378264.613473:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378264.613479:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ae00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378264.613481:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378264.613489:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378264.613495:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378264.613501:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787378264.613503:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787378264.613505:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787378264.613510:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eeb88277000 00010000:00010000:1.0:1787378264.613513:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378264.613527:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ae00/0xdd3c5462d7852e8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852e95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378264.613536:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378264.613538:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378264.613539:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378264.617339:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787378264.626490:0:13024:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9eea82427f00 - data ffff9eebb0b05870/ffff9eebbb279c00 00000020:01000000:0.0:1787378264.626643:0:13024:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9eeb904690c0 - data ffff9eeba8828af8/ffff9eeb8833d800 00100000:10000000:0.0:1787378264.649071:0:13024:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787378264.709901:0:13024:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852a74 00000020:00000080:1.0:1787378264.709911:0:13024:0:(genops.c:906:class_export_put()) final put ffff9eebbf7b9000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787378264.709931:0:13024:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eeb88344000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787378264.709935:0:13024:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eeb88344000 2 00000020:01000004:1.0:1787378264.709938:0:13024:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eeb88344000 from lustre-OST0000 00000020:00000080:1.0:1787378264.709965:0:13024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787378264.709975:0:13024:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787378264.709978:0:13024:0:(genops.c:906:class_export_put()) final put ffff9eebb3dff800/lustre-OST0000_UUID 00000020:00000080:1.0:1787378264.709981:0:13024:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebb3dff800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787378264.709987:0:13024:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787378264.710032:0:13024:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787378264.710038:0:13024:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787378264.710043:0:13024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787378264.710047:0:13024:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787378264.710054:0:13024:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9eebbf7bc800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787378264.710060:0:13024:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9eeb87790000) has exports, disconnecting them 00000020:00080000:1.0:1787378264.710066:0:13024:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9eebbf7bc800), last request at 1787378039 00000020:00000080:1.0:1787378264.710070:0:13024:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852a9e 00000020:00080000:1.0:1787378264.710081:0:13024:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eebbf7bc800): rc 0 00000020:00000080:1.0:1787378264.710085:0:13024:0:(genops.c:906:class_export_put()) final put ffff9eebbf7bc800/lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787378264.710633:0:13024:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787378264.710639:0:13024:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787378264.710657:0:13024:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787378264.710663:0:13024:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787378264.710791:0:13024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787378264.710808:0:13024:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787378264.710812:0:13024:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eeb88344000 1 00000020:00000080:1.0:1787378264.710816:0:13024:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852a2e 00000020:00000080:1.0:1787378264.710820:0:13024:0:(genops.c:906:class_export_put()) final put ffff9eebbb180000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787378264.710824:0:13024:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787378264.710827:0:13024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787378264.710830:0:13024:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787378264.710833:0:13024:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9eeb91794d40) has no exports 00000020:00000080:3.0:1787378264.710954:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbf7b9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787378264.710967:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbf7bc800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787378264.710971:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eebbf7bf000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787378264.710983:0:8:0:(genops.c:906:class_export_put()) final put ffff9eebbf7ba800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787378264.710985:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbf7ba800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787378264.710989:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787378264.711034:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbb180000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787378264.774026:0:13024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787378264.774042:0:13024:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787378264.774047:0:13024:0:(genops.c:906:class_export_put()) final put ffff9eeb88347800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787378264.774050:0:13024:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb88347800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787378264.774786:0:13024:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787378264.774939:0:13024:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eeb88340000 00000020:02000400:0.0:1787378264.774982:0:13024:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787378265.049975:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378266.073824:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378267.101836:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787378267.694502:0:13177:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787378267.707185:0:13177:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787378267.707298:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378267.707318:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378267.707327:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378267.707335:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378267.707359:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787378267.707366:0:13177:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787378267.709137:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378267.709157:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378267.709172:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04c00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:3.0:1787378267.709177:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378267.709189:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378267.709224:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378267.709231:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787378267.709235:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787378267.709238:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787378267.709261:0:5780:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eeb88277000 00010000:00010000:3.0:1787378267.709266:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378267.709273:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7852c3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852c42 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378267.709291:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378267.709293:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378267.709296:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787378267.709321:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787378267.709338:0:13177:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eebbb720a80 x1874201626629504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378269 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378267.709363:0:13177:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eebad2e1180 x1874201626630016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378267.709377:0:13177:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eebae6fb100 x1874201626630144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378280 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378267.711390:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626630016:0@lo:400:kworker.0 00000100:00100000:3.0:1787378267.713344:0:13177:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787378267.713363:0:13177:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787378267.719169:0:13177:0:(import.c:65:import_set_state_nolock()) ffff9eea821c2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787378267.719274:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874201626630400:0@lo:39:umount.0 00000100:00100000:1.0:1787378267.719402:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874201626629504:0@lo:400:kworker.0 00000400:00000100:0.0:1787378267.721245:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874201626630400 offset 0 length 224: 4 00000100:00100000:3.0:1787378267.722787:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626630144:0@lo:400:kworker.0 00010000:00010000:1.0:1787378268.122255:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378269.146122:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787378269.726073:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787378269.726083:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787378270.171561:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378271.193953:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378272.219532:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378273.242936:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378274.265957:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787378274.842543:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787378274.842557:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787378275.290170:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378276.313975:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378277.338039:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378277.914104:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787378267/real 1787378267] req@ffff9eebbb720e00 x1874201626630400/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787378277 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378277.914143:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eebbb720e00 x1874201626630400/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787378277 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787378277.914166:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eea821c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787378277.914187:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874201626630400:0@lo:39:umount.0 00000100:00080000:3.0:1787378277.918285:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787378277.918299:0:13177:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787378277.918309:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787378277.919343:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.919364:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.919373:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.919380:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.919414:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378277.919423:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.919430:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.919436:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.919442:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.919495:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787378277.919501:0:13177:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787378277.919532:0:13177:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787378277.919539:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787378277.919544:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378277.919551:0:13177:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787378277.919556:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9eebb5384d40) has no exports 00000020:00080000:3.0:1787378277.919589:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9eebb5384d40) has no exports 00010000:00010000:0.0:1787378277.920031:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787378277.920042:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378277.920054:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484e00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:0.0:1787378277.920059:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378277.920070:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787378277.920078:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378277.920109:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787378277.920112:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787378277.920115:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787378277.920134:0:5780:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eeb88277000 00010000:00010000:0.0:1787378277.920138:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378277.920146:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81484e00/0xdd3c5462d7852c49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852c50 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378277.920175:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378277.920180:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378277.920186:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05e00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:0.0:1787378277.920189:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378277.920196:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787378277.920202:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378277.920208:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787378277.920210:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787378277.920212:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787378277.920217:0:5780:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eeb88277000 00010000:00010000:0.0:1787378277.920221:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378277.920402:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05e00/0xdd3c5462d7852e80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852e87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378277.920420:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378277.920422:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378277.920424:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787378277.921380:0:13177:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9eea824278a0 - data ffff9eebbfdf0a20/ffff9eeb90563400 00000020:01000000:3.0:1787378277.921557:0:13177:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9eeb90c72a20 - data ffff9eebbfdfb948/ffff9eebbf760c00 00010000:00010000:2.0:1787378277.921986:0:6602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787378277.939125:0:13177:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787378277.984471:0:13177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852b3f 00000020:00000080:3.0:1787378277.984486:0:13177:0:(genops.c:906:class_export_put()) final put ffff9eebad27b000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787378277.984558:0:13177:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eebbb181000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787378277.984563:0:13177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eebbb181000 2 00000020:01000004:3.0:1787378277.984566:0:13177:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eebbb181000 from lustre-OST0001 00000020:00000080:3.0:1787378277.984599:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787378277.984614:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787378277.984618:0:13177:0:(genops.c:906:class_export_put()) final put ffff9eebad27a800/lustre-OST0001_UUID 00000020:00000080:3.0:1787378277.984621:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebad27a800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787378277.984631:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787378277.984827:0:13177:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import fcf23d9b-e184-4291-9fe7-ec0ed8a185e6->MGS 00010000:00010000:3.0:1787378277.984847:0:13177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852a58 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378277.984862:0:13177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852a58 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378277.984869:0:13177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787378277.984883:0:13177:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787378277.984887:0:13177:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787378277.984908:0:13177:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eeb88277000 00010000:00010000:3.0:1787378277.984913:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81546c00/0xdd3c5462d7852a51 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852a58 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378277.984932:0:13177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd3c5462d7852c96 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787378277.984939:0:13177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd3c5462d7852c96 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378277.984944:0:13177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787378277.984946:0:13177:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787378277.984948:0:13177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787378277.984958:0:13177:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eeb88277000 00010000:00010000:3.0:1787378277.984971:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81485600/0xdd3c5462d7852c8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd3c5462d7852c96 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787378277.984989:0:13177:0:(import.c:65:import_set_state_nolock()) ffff9eeb88277000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787378277.984995:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787378277.984998:0:13177:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787378277.985000:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787378277.985005:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787378277.985018:0:13177:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eebbb722300 x1874201626630272/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787378279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787378277.985587:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787378277.985593:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:0.0:1787378277.985935:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebad27b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787378277.986072:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fcf23d9b-e184-4291-9fe7-ec0ed8a185e6:3310:1874201626630272:0@lo:250:kworker.0 10000000:01000000:3.0:1787378277.986332:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787378277.986345:0:13177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852932 00000020:00000080:3.0:1787378277.986353:0:13177:0:(genops.c:906:class_export_put()) final put ffff9eeb84483800/fcf23d9b-e184-4291-9fe7-ec0ed8a185e6 00000020:01000000:3.0:1787378277.986368:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.122@tcp (flags='') 00000020:00000080:3.0:1787378277.986388:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378277.986396:0:13177:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.122@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787378277.986401:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9eeb882799c0) has no exports 00000020:00000080:0.0:1787378277.986450:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb84483800/fcf23d9b-e184-4291-9fe7-ec0ed8a185e6 for MGC192.168.203.122@tcp 10000000:01000000:1.0:1787378277.986498:0:5788:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787378277.986753:0:13177:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.122@tcp: client import never connected 00000100:00080000:3.0:1787378277.986758:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787378277.986761:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787378277.986763:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787378277.986766:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787378277.986814:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787378277.986821:0:13177:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.122@tcp (uuid fcf23d9b-e184-4291-9fe7-ec0ed8a185e6) 00000020:01000000:3.0:1787378277.986828:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787378277.986831:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378277.986835:0:13177:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787378277.986841:0:13177:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9eea821c3000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787378277.986846:0:13177:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9eeb91793380) has exports, disconnecting them 00000020:00080000:3.0:1787378277.986851:0:13177:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9eea821c3000), last request at 1787378055 00000020:00000080:3.0:1787378277.986855:0:13177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852b69 00000020:00080000:3.0:1787378277.986868:0:13177:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eea821c3000): rc 0 00000020:00000080:3.0:1787378277.986872:0:13177:0:(genops.c:906:class_export_put()) final put ffff9eea821c3000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787378277.987063:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eeb88277000 for MGC192.168.203.122@tcp 00000020:00000080:0.0:1787378277.987071:0:478:0:(genops.c:906:class_export_put()) final put ffff9eeb88273000/fcf23d9b-e184-4291-9fe7-ec0ed8a185e6 00000020:00000080:0.0:1787378277.987073:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb88273000/fcf23d9b-e184-4291-9fe7-ec0ed8a185e6 for MGC192.168.203.122@tcp 00000020:01000000:0.0:1787378277.987090:0:478:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.122@tcp (fcf23d9b-e184-4291-9fe7-ec0ed8a185e6) 00000020:00000080:0.0:1787378277.987583:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eea821c3000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787378278.059110:0:13177:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787378278.059122:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787378278.059127:0:13177:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787378278.059137:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787378278.059241:0:478:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9eea821c2800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787378278.059327:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787378278.059664:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787378278.059894:0:6602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787378278.060041:0:5774:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9eeb83f5ea00:5774] 0 exiting: rc = 1 00000100:00100000:1.0:1787378278.060314:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9eeb86058400:5775] 1 exiting: rc = 0 00000100:00100000:3.0:1787378278.064048:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.064506:0:6603:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9eeb8765ca00:6603] 3 exiting: rc = 0 00000100:00100000:3.0:1787378278.064507:0:5778:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9eeb90c8fc00:5778] 2 exiting: rc = 0 00000100:00100000:1.0:1787378278.064660:0:8358:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9eebaf43e200:8358] 4 exiting: rc = 0 00000100:00100000:1.0:1787378278.064769:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9eeb90c8f200:5777] 1 exiting: rc = 0 00000100:00100000:1.0:1787378278.065111:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9eeb904eb400:5776] 0 exiting: rc = 1 00000100:00100000:3.0:1787378278.065601:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065611:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065618:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065625:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065632:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065648:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065656:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065663:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065671:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065676:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065682:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065690:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065696:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065738:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065748:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065756:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065763:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065769:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065775:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065783:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065790:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065796:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065801:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065806:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065812:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065817:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065823:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065828:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065835:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065841:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065847:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065854:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065861:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065869:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065875:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065882:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065888:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065895:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065902:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065909:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065925:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065932:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065939:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065946:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065953:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065963:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065970:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065976:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065986:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065993:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.065999:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066005:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066011:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066017:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066024:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066033:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066041:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066047:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066053:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066059:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066067:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066074:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066082:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.066088:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787378278.072161:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787378278.072184:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787378278.072191:0:13177:0:(genops.c:906:class_export_put()) final put ffff9eeb866c7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787378278.072197:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb866c7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787378278.072206:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787378278.072282:0:13177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eebbb181000 1 00000020:00000080:3.0:1787378278.072289:0:13177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd3c5462d7852b0e 00000020:00000080:3.0:1787378278.072297:0:13177:0:(genops.c:906:class_export_put()) final put ffff9eeb87618000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787378278.072327:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787378278.072332:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787378278.072582:0:13177:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787378278.072586:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9eeb883b19c0) has no exports 00000020:00000080:1.0:1787378278.073902:0:478:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb87618000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787378278.122220:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787378278.122807:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787378278.122829:0:13177:0:(genops.c:906:class_export_put()) final put ffff9eeb8769f000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787378278.122835:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9eeb8769f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787378278.122854:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787378278.125007:0:13177:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eeb8769c800 00000020:01000000:2.0:1787378278.125048:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787378278.125059:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787378278.125066:0:13177:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787378278.125071:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9eeb883b3380) has no exports 00000020:00000080:2.0:1787378278.125108:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787378278.125121:0:13177:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787378278.125127:0:13177:0:(genops.c:906:class_export_put()) final put ffff9eebbb184000/OSS_uuid 00000020:00000080:2.0:1787378278.125131:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9eebbb184000/OSS_uuid for OSS 00000020:01000000:2.0:1787378278.125137:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787378278.125342:0:5787:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787378278.125386:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9eebae5d1a00:6588] 1 exiting: rc = 0 00000100:00100000:3.0:1787378278.125666:0:8120:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9eeb88309000:8120] 3 exiting: rc = 0 00000100:00100000:0.0:1787378278.133829:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9eebae04c200:6589] 2 exiting: rc = 0 00000100:00100000:3.0:1787378278.137964:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9eebae04cc00:6586] 0 exiting: rc = 1 00000100:00100000:2.0:1787378278.138964:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.138981:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.138989:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.138999:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139005:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139012:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139018:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139023:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139029:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139035:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139041:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139047:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139052:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139058:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139063:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139069:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139074:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139080:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139086:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139092:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139097:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139126:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139131:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139137:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139143:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139148:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139154:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139160:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139166:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139171:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139177:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139183:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139189:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139195:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139200:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139209:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139216:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139221:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139227:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139232:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139243:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139252:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139258:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139264:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139269:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139275:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139280:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139286:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139292:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139298:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139303:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139309:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139316:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139321:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139326:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139331:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139345:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139351:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139357:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139362:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139368:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139373:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139378:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.139396:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.142901:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9eeb8a245600:6591] 1 exiting: rc = 0 00000100:00100000:2.0:1787378278.143139:0:11748:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9eebbb1e4c00:11748] 2 exiting: rc = 0 00000100:00100000:0.0:1787378278.144028:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9eebae5d0800:6590] 0 exiting: rc = 1 00000100:00100000:3.0:1787378278.144904:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144917:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144923:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144930:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144935:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144941:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144946:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144952:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144957:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144963:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144969:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144975:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144982:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144988:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.144994:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145000:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145005:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145012:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145020:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145026:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145032:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145038:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145043:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145048:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145053:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145058:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145063:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145069:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145074:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145097:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145102:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145108:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145114:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145119:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145125:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145131:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145137:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145141:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145147:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145153:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145158:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145163:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145168:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145175:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145181:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145187:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145193:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145200:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145206:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145211:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145217:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145222:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145228:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145234:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145240:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145246:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145252:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145257:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145262:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145269:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145276:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145281:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145286:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787378278.145291:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.151631:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9eeb8a244e00:6592] 0 exiting: rc = 1 00000100:00100000:1.0:1787378278.152577:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9eeb8a244800:6594] 2 exiting: rc = 0 00000100:00100000:0.0:1787378278.155246:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9eeb8a245e00:6593] 1 exiting: rc = 0 00000100:00100000:2.0:1787378278.155420:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155430:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155437:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155443:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155451:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155460:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155471:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155478:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155485:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155491:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155501:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155509:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155515:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155523:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155530:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155538:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155544:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155550:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155556:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155562:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155568:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155591:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155598:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155603:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155608:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155627:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155632:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155638:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155644:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155649:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155656:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155663:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155680:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155688:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155694:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155700:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155715:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155857:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155865:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155870:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155876:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155881:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155888:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155894:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155900:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155923:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155931:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155945:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155952:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155959:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155966:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155973:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155979:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155987:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.155994:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156000:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156006:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156014:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156022:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156030:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156046:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156053:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156060:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787378278.156068:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787378278.166122:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9eeb8a245200:6595] 0 exiting: rc = 1 00000100:00100000:1.0:1787378278.166332:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9eeb8a245400:6596] 1 exiting: rc = 0 00000100:00100000:1.0:1787378278.166407:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166416:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166421:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166427:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166433:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166439:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166445:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166451:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166457:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166463:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166469:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166475:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166481:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166486:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166493:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166499:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166504:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166509:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166515:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166520:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166525:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166530:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166535:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166540:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166545:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166550:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166555:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166560:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166566:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166590:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166595:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166601:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166607:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166612:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166618:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166623:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166628:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166634:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166639:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166645:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166652:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166659:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166664:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166669:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166675:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166680:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166685:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166690:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166695:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166699:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166714:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166742:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166748:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166754:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166759:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166764:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166770:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166775:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166781:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166786:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166792:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166796:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166802:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.166807:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167571:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9eeb9e0cb600:6597] 0 exiting: rc = 1 00000100:00100000:1.0:1787378278.167648:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9eeb9e0cb000:6598] 1 exiting: rc = 0 00000100:00100000:1.0:1787378278.167698:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167739:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167748:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167757:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167764:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167771:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167778:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167784:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167806:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167834:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167840:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167847:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167853:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167859:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167866:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167873:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167879:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167885:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167892:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167900:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167923:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167931:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167937:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167943:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167949:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167954:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167961:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167966:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167974:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167980:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167986:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.167992:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168011:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168030:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168038:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168048:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168056:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168063:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168069:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168076:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168083:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168090:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168097:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168104:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168125:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168132:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168139:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168146:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168155:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168162:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168169:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168175:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168182:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168189:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168195:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168202:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168225:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168234:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168242:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168249:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168257:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168265:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168271:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787378278.168278:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787378278.185336:0:13177:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787378297.666338:0:13797:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787378306.959422:0:14210:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787378306.959428:0:14210:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787378306.959552:0:14210:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9eebbc37f000 00000020:01000004:1.0:1787378306.959566:0:14210:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787378306.959582:0:14210:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787378306.959596:0:14210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9eeb8827cd40) 00000020:00000080:1.0:1787378306.959608:0:14210:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787378306.990539:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787378306.993125:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787378306.994120:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 415: rc = 0 00100000:10000000:2.0:1787378306.994217:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 415: rc = 0 00100000:10000000:2.0:1787378306.994681:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 415: rc = 0 00100000:10000000:2.0:1787378306.995095:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787378306.995168:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 415: rc = 0 00100000:10000000:2.0:1787378306.995269:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 415: rc = 0 00100000:10000000:2.0:1787378306.995636:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 415: rc = 0 00100000:10000000:2.0:1787378306.996095:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 417: rc = 0 00100000:10000000:2.0:1787378307.002134:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 553: rc = 0 00100000:10000000:2.0:1787378307.002245:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 553: rc = 0 00100000:10000000:2.0:1787378307.004705:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 326: rc = 0 00100000:10000000:2.0:1787378307.007096:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 326: rc = 0 00100000:10000000:2.0:1787378307.007410:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 326: rc = 0 00100000:10000000:2.0:1787378307.009763:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 326: rc = 0 00100000:10000000:2.0:1787378307.010251:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 326: rc = 0 00100000:10000000:3.0:1787378307.016455:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 326: rc = 0 00100000:10000000:3.0:1787378307.018108:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 326: rc = 0 00100000:10000000:3.0:1787378307.018528:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 326: rc = 0 00100000:10000000:3.0:1787378307.019065:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 326: rc = 0 00100000:10000000:3.0:1787378307.019450:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 326: rc = 0 00100000:10000000:3.0:1787378307.019922:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 326: rc = 0 00100000:10000000:3.0:1787378307.020169:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 326: rc = 0 00100000:10000000:3.0:1787378307.021033:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 563: rc = 0 00100000:10000000:3.0:1787378307.021281:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 563: rc = 0 00100000:10000000:3.0:1787378307.022685:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 563: rc = 0 00100000:10000000:3.0:1787378307.023681:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 563: rc = 0 00100000:10000000:3.0:1787378307.027246:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 563: rc = 0 00100000:10000000:3.0:1787378307.027538:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 563: rc = 0 00100000:10000000:3.0:1787378307.027830:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 563: rc = 0 00100000:10000000:3.0:1787378307.028110:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 563: rc = 0 00100000:10000000:3.0:1787378307.028352:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 563: rc = 0 00100000:10000000:3.0:1787378307.030979:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 563: rc = 0 00100000:10000000:3.0:1787378307.031585:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 563: rc = 0 00100000:10000000:3.0:1787378307.032597:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 563: rc = 0 00100000:10000000:3.0:1787378307.033691:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 563: rc = 0 00100000:10000000:3.0:1787378307.036517:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 563: rc = 0 00100000:10000000:3.0:1787378307.037240:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 563: rc = 0 00100000:10000000:3.0:1787378307.037650:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 563: rc = 0 00100000:10000000:3.0:1787378307.038140:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 563: rc = 0 00100000:10000000:3.0:1787378307.039653:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 563: rc = 0 00100000:10000000:3.0:1787378307.040169:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 563: rc = 0 00100000:10000000:3.0:1787378307.041052:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 563: rc = 0 00100000:10000000:3.0:1787378307.041435:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 563: rc = 0 00100000:10000000:3.0:1787378307.041674:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 563: rc = 0 00100000:10000000:3.0:1787378307.042207:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 563: rc = 0 00100000:10000000:3.0:1787378307.042496:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 563: rc = 0 00100000:10000000:3.0:1787378307.042803:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 563: rc = 0 00100000:10000000:3.0:1787378307.043046:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 563: rc = 0 00100000:10000000:3.0:1787378307.043291:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 563: rc = 0 00100000:10000000:2.0:1787378307.044459:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 563: rc = 0 00100000:10000000:2.0:1787378307.045558:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 563: rc = 0 00100000:10000000:2.0:1787378307.046007:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 563: rc = 0 00100000:10000000:2.0:1787378307.046253:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 563: rc = 0 00100000:10000000:2.0:1787378307.046636:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 563: rc = 0 00100000:10000000:2.0:1787378307.047236:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 644: rc = 0 00100000:10000000:2.0:1787378307.048045:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787378307.048224:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 554: rc = 0 00100000:10000000:2.0:1787378307.048557:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787378307.048628:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 554: rc = 0 00100000:10000000:2.0:1787378307.049056:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787378307.049129:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 554: rc = 0 00100000:10000000:2.0:1787378307.049645:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787378307.049741:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 118: rc = 0 00100000:10000000:2.0:1787378307.050129:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787378307.050199:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 118: rc = 0 00100000:10000000:2.0:1787378307.050538:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787378307.050608:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 118: rc = 0 00000020:00000080:2.0:1787378307.051246:0:14210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787378307.051253:0:14210:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787378307.051264:0:14210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7853c33 00000020:01000004:2.0:1787378307.051271:0:14210:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787378307.051276:0:14210:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787378307.051280:0:14210:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eebbc37f000 from MGS 00000020:01000004:2.0:1787378307.051284:0:14210:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787378307.051303:0:14210:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9eeb883b19c0) 00000020:00000080:2.0:1787378307.051315:0:14210:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787378307.051481:0:14210:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eebbc37f000 from MGS, refs=2 00080000:01000000:2.0:1787378307.051486:0:14210:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787378307.051491:0:14210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7853c41 00000100:00100000:2.0:1787378307.051595:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787378307.051708:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787378307.051715:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787378307.055070:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787378307.055086:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787378307.060671:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378307.061002:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787378307.061016:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787378307.064636:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787378307.064658:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787378307.065248:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787378307.065256:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787378307.066086:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378307.066091:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378307.066093:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378307.066419:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378307.066422:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378307.066424:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378307.066897:0:14210:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787378307.068417:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787378307.102204:0:14210:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787378307.102223:0:14210:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787378307.102226:0:14210:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787378307.107586:0:14219:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787378307.107830:0:14210:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787378307.107946:0:14210:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787378307.110747:0:14210:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787378307.111200:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378307.111949:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787378307.111956:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787378307.126092:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787378307.126107:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787378307.126537:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787378307.126544:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787378307.128466:0:14210:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787378307.128491:0:14210:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.122@tcp' 00000020:01000004:2.0:1787378307.128494:0:14210:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787378307.128534:0:14210:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.122@tcp (typ=mgc) 00000020:00000080:2.0:1787378307.128547:0:14210:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.122@tcp (ffff9eeb883b3380) 00000020:00000080:2.0:1787378307.128562:0:14210:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787378307.128634:0:14210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eeb8769f800@MGC192.168.203.122@tcp: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1787378307.128948:0:14210:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.122@tcp-0 is initialized 00000040:01000000:2.0:1787378307.128956:0:14210:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787378307.129178:0:14224:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787378307.130075:0:14225:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787378307.149659:0:14210:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.122@tcp (uuid 606b5901-a2d8-4f42-a60c-6eb8ab84a876) 00000020:00000080:1.0:1787378307.149686:0:14210:0:(genops.c:1406:class_connect()) connect: client 606b5901-a2d8-4f42-a60c-6eb8ab84a876, cookie 0xdd3c5462d7853c4f 00000100:00080000:1.0:1787378307.149699:0:14210:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787378307.149706:0:14210:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9eeb8769f800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787378307.149778:0:14210:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae6faa00 x1874201626630528/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787378307.149804:0:14210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 606b5901-a2d8-4f42-a60c-6eb8ab84a876->MGS 00000020:01000004:1.0:1787378307.149822:0:14210:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787378307.149827:0:14210:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787378307.149841:0:14210:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9eeb8827b380) 00000020:00000080:1.0:1787378307.149856:0:14210:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787378307.155056:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3310:1874201626630528:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787378307.155130:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378307.165899:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626630528 00000100:00100000:0.0:1787378307.165913:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626630528 00000100:00100000:0.0:1787378307.165964:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787378307.165973:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874201626630528:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787378307.166002:0:14220:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 606b5901-a2d8-4f42-a60c-6eb8ab84a876@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:0.0:1787378307.166029:0:14220:0:(genops.c:1406:class_connect()) connect: client 606b5901-a2d8-4f42-a60c-6eb8ab84a876, cookie 0xdd3c5462d7853c5d 00000100:00080000:0.0:1787378307.166153:0:14220:0:(import.c:65:import_set_state_nolock()) ffff9eebae766800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378307.166234:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+5:3310:x1874201626630528:12345-0@lo:250:mount.lustre.0 Request processed in 261us (11104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378307.166243:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787378307.166284:0:3310:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787378307.166292:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.122@tcp: connect to target with instance 0 00000100:00080000:0.0:1787378307.166299:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787378307.166304:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787378307.166307:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eeb8769f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787378307.166310:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787378307.166326:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787378307.166332:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3310:1874201626630528:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787378307.187345:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787378307.187535:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787378307.187541:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787378307.191544:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787378307.191558:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787378307.197370:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787378307.197392:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787378307.198863:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787378307.199019:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787378307.199024:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787378307.206402:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787378307.206415:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787378307.301037:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378307.301225:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787378307.301231:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787378307.305252:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787378307.305265:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787378307.315261:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787378307.315438:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787378307.315445:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787378307.317996:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787378307.318008:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787378307.319020:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378307.319198:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787378307.319203:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787378307.321043:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787378307.321055:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787378307.325871:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787378307.326041:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787378307.326046:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787378307.328122:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787378307.328135:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787378307.376565:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787378307.376966:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787378307.376973:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787378307.401177:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787378307.401197:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787378307.404539:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787378307.404550:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787378307.407150:0:14210:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787378307.407174:0:14210:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787378307.407181:0:14210:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787378307.407318:0:14210:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787378307.407351:0:14210:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787378307.407356:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787378307.407357:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787378307.407359:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378307.407360:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378307.407361:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378307.407363:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378307.407364:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787378307.407366:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787378307.407368:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378307.407369:0:14210:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787378307.407372:0:14210:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787378307.407374:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787378307.407376:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787378307.407377:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378307.407378:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378307.407379:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378307.407380:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378307.407381:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787378307.407382:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787378307.407383:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378307.407384:0:14210:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787378307.407412:0:14210:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787378307.407433:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626630656:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787378307.407559:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378307.407617:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787378307.407860:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626630656 00000100:00100000:0.0:1787378307.407867:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626630656 00000100:00100000:0.0:1787378307.407910:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787378307.407918:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+5:14210:x1874201626630656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787378307.407966:0:14223:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787378307.407969:0:14223:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787378307.407971:0:14223:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787378307.411770:0:14244:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787378307.412284:0:14223:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787378307.414966:0:14245:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787378307.414973:0:14245:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787378307.414976:0:14245:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787378307.415010:0:14245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787378307.415481:0:14223:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787378307.415491:0:14223:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787378307.436787:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+5:14210:x1874201626630656:12345-0@lo:253:mount.lustre.0 Request processed in 28860us (29220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.436820:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787378307.437156:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626630656:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787378307.437171:0:14210:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787378307.437175:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787378307.437177:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787378307.437178:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378307.437180:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378307.437181:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378307.437182:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378307.437184:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787378307.437185:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787378307.437187:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378307.437188:0:14210:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787378307.437208:0:14210:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eebbc37f000 from lustre-MDT0000 10000000:01000000:1.0:1787378307.437231:0:14210:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787378307.437234:0:14210:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787378307.437238:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9eeb883b3380 10000000:01000000:1.0:1787378307.437242:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787378307.437249:0:14210:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9eeb883b3380 from 1 10000000:01000000:1.0:1787378307.437252:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787378307.437285:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.437296:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.437306:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378307.437323:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626630784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787378307.437381:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378307.437425:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207840 going to sleep for 11 seconds 00000100:00100000:0.0:1787378307.437493:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626630784 00000100:00100000:0.0:1787378307.437500:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626630784 00000100:00100000:0.0:1787378307.437548:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787378307.437557:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+5:14210:x1874201626630784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787378307.437570:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378307.437584:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128b600/0xdd3c5462d7853c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853c64 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378307.437606:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128b600/0xdd3c5462d7853c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853c64 expref: 6 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378307.437616:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128b600/0xdd3c5462d7853c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853c64 expref: 6 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378307.437626:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b600, rc 0) 00000100:00100000:0.0:1787378307.437663:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+6:14210:x1874201626630784:12345-0@lo:101:mount.lustre.0 Request processed in 107us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378307.437669:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787378307.437935:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626630784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787378307.437949:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.437958:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378307.438005:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626630912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787378307.438029:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378307.438048:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207840 going to sleep for 11 seconds 00000100:00100000:0.0:1787378307.438100:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626630912 00000100:00100000:0.0:1787378307.438104:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626630912 00000100:00100000:0.0:1787378307.438136:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787378307.438142:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+6:14210:x1874201626630912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787378307.438368:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+6:14210:x1874201626630912:12345-0@lo:501:mount.lustre.0 Request processed in 225us (336us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787378307.438381:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787378307.438715:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626630912:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787378307.438975:0:14210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787378307.438996:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.439007:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378307.439016:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eebbc37f000 10000000:01000000:3.0:1787378307.439022:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787378307.439033:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9eebbc37f000 10000000:01000000:3.0:1787378307.439035:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787378307.439039:0:14210:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9eebbc37f000 from 1 10000000:01000000:3.0:1787378307.439041:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787378307.439067:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7853c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.439075:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7853c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.439085:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7853c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378307.439100:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626631040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787378307.439132:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378307.439153:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.439228:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626631040 00000100:00100000:2.0:1787378307.439233:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626631040 00000100:00100000:2.0:1787378307.439269:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787378307.439277:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+6:14210:x1874201626631040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787378307.439286:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378307.439300:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc0400/0xdd3c5462d7853c79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853c72 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.439318:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc0400/0xdd3c5462d7853c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853c72 expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.439327:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc0400/0xdd3c5462d7853c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853c72 expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.439335:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0400, rc 0) 00000100:00100000:2.0:1787378307.439366:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+7:14210:x1874201626631040:12345-0@lo:101:mount.lustre.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.439371:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787378307.440977:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626631040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378307.441001:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7853c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c79 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.441013:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7853c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853c79 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378307.441036:0:14210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787378307.441054:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7853c72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c79 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.441062:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04c00/0xdd3c5462d7853c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c79 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378307.441089:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787378307.441093:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787378307.441100:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9eebbc37f000 10000000:01000000:3.0:1787378307.441102:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787378307.441106:0:14210:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787378307.441108:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787378307.441134:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04e00/0xdd3c5462d7853c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.441141:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04e00/0xdd3c5462d7853c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.441149:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04e00/0xdd3c5462d7853c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378307.441168:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626631168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787378307.441213:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378307.441246:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.441983:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626631168 00000100:00100000:2.0:1787378307.441991:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626631168 00000100:00100000:2.0:1787378307.442041:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787378307.442050:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+7:14210:x1874201626631168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787378307.442063:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378307.442075:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc1a00/0xdd3c5462d7853c87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853c80 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.442098:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc1a00/0xdd3c5462d7853c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853c80 expref: 8 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.442117:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc1a00/0xdd3c5462d7853c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853c80 expref: 8 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.442126:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1a00, rc 0) 00000100:00100000:2.0:1787378307.442180:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+8:14210:x1874201626631168:12345-0@lo:101:mount.lustre.0 Request processed in 132us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.442189:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787378307.443808:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626631168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378307.443832:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04e00/0xdd3c5462d7853c80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c87 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.443843:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04e00/0xdd3c5462d7853c80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853c87 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378307.443918:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626631296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378307.443966:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378307.444017:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787378307.448268:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626631296 00000100:00100000:1.0:1787378307.448282:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626631296 00000100:00100000:1.0:1787378307.448347:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378307.448358:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+8:14210:x1874201626631296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787378307.448835:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+9:14210:x1874201626631296:12345-0@lo:501:mount.lustre.0 Request processed in 478us (4867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378307.448843:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787378307.451440:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626631296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378307.451535:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626631424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787378307.451605:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378307.451647:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.451755:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626631424 00000100:00100000:2.0:1787378307.451771:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626631424 00000100:00100000:2.0:1787378307.451813:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787378307.451822:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+9:14210:x1874201626631424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787378307.452160:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+9:14210:x1874201626631424:12345-0@lo:503:mount.lustre.0 Request processed in 338us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.452169:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787378307.452660:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626631424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787378307.453061:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14246:1874201626631552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378307.453106:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378307.453138:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8763fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.453804:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626631552 00000100:00100000:2.0:1787378307.453812:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626631552 00000100:00100000:2.0:1787378307.453858:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787378307.453867:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+9:14246:x1874201626631552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378307.454166:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+9:14246:x1874201626631552:12345-0@lo:502:llog_process_th.0 Request processed in 299us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.454174:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787378307.454338:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14246:1874201626631552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787378307.454364:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787378307.454375:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378307.454377:0:14246:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787378307.454382:0:14246:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787378307.454385:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787378307.454398:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9eeb91793380) 00000020:00000080:3.0:1787378307.454415:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787378307.454420:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787378307.454500:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787378307.454516:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7853c95 00000020:00000080:3.0:1787378307.454706:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787378307.454711:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378307.454714:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378307.454716:0:14246:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787378307.454773:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787378307.454778:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378307.454780:0:14246:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787378307.454783:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787378307.454796:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9eeb917919c0) 00000020:00000080:3.0:1787378307.454806:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787378307.454811:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787378307.454813:0:14246:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787378307.454815:0:14246:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787378307.454820:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787378307.454857:0:14246:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eebbc37f000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787378307.454867:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9eeb91790000) 00000020:00000080:3.0:1787378307.454874:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787378307.454919:0:14246:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787378307.454925:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7853caa 00000020:00000080:3.0:1787378307.455015:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787378307.455021:0:14246:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787378307.455026:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdd3c5462d7853cb1 00080000:01000000:3.0:1787378307.455030:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787378307.455034:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7853cb8 00010000:00010000:1.0:1787378307.619660:0:14246:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787378307.620175:0:14246:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1787378307.620354:0:14246:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787378307.621212:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9eeb882799c0) 00000020:00000080:1.0:1787378307.621232:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787378307.621297:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787378307.621304:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7853cc6 00000020:00000080:1.0:1787378307.626169:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787378307.646565:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdd3c5462d7853ccd 00000020:00000080:2.0:1787378307.651013:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787378307.651028:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378307.651037:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.651040:0:14246:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787378307.651046:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378307.651066:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.651067:0:14246:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787378307.651073:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787378307.651119:0:14246:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787378307.651137:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378307.651141:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.651142:0:14246:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787378307.651145:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787378307.651147:0:14246:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1787378307.651148:0:14246:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787378307.651150:0:14246:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787378307.651152:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787378307.651154:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.651155:0:14246:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787378307.651158:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787378307.651161:0:14246:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787378307.651164:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.651166:0:14246:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787378307.651169:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787378307.651173:0:14246:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:2.0:1787378307.651210:0:14246:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787378307.651213:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787378307.651227:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9eeb883b4d40) 00000020:00000080:2.0:1787378307.651244:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787378307.651248:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787378307.651301:0:14246:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787378307.651307:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787378307.651314:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7853cdb 00010000:00080000:2.0:1787378307.651344:0:14246:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eebad27c000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1787378307.651570:0:14246:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787378307.652087:0:14246:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787378307.652128:0:14246:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787378307.661273:0:14246:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787378307.661343:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787378307.661412:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787378307.662405:0:14250:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787378307.662412:0:14250:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787378307.663562:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787378307.663575:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787378307.663607:0:14246:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787378307.663625:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7853ce2 00000100:00080000:3.0:1787378307.663634:0:14246:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787378307.663640:0:14246:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eebad27c000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787378307.663673:0:14246:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebbb722d80 x1874201626631680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787378307.663702:0:14246:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787378307.663916:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626631680:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787378307.663964:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874201626631680 offset 0 length 520: 4 00000020:01000000:3.0:1787378307.664127:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787378307.664132:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378307.664134:0:14246:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787378307.664137:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787378307.664147:0:14246:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787378307.664148:0:14246:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787378307.664150:0:14246:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787378307.664152:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787378307.664155:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378307.664156:0:14246:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787378307.664159:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787378307.664163:0:14246:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787378307.664166:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787378307.664167:0:14246:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787378307.664170:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787378307.664174:0:14246:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:3.0:1787378307.664192:0:14246:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787378307.664194:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787378307.664205:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9eeb91794d40) 00000020:00000080:3.0:1787378307.664217:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787378307.664221:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787378307.664286:0:14246:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787378307.664291:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787378307.664298:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd3c5462d7853cf0 00010000:00080000:3.0:1787378307.664322:0:14246:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eebbc248800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1787378307.664537:0:14246:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787378307.664708:0:14246:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787378307.669417:0:14246:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787378307.676086:0:14246:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787378307.676203:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787378307.676269:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787378307.677047:0:14252:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787378307.677053:0:14252:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787378307.679181:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787378307.679194:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787378307.679229:0:14246:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787378307.679246:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7853cf7 00000100:00080000:2.0:1787378307.679255:0:14246:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787378307.679260:0:14246:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eebbc248800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787378307.679295:0:14246:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae274000 x1874201626631808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787378307.679321:0:14246:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787378307.679370:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378307.679374:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.679376:0:14246:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787378307.679379:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378307.679383:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.679384:0:14246:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787378307.679387:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787378307.679389:0:14246:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787378307.679391:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378307.679393:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.679395:0:14246:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787378307.679397:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378307.679399:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.679401:0:14246:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787378307.679404:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787378307.679434:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14246:1874201626631936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378307.679524:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.679558:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787378307.679783:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626631936 00000100:00100000:3.0:1787378307.679791:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626631936 00000100:00100000:3.0:1787378307.679831:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787378307.679841:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+9:14246:x1874201626631936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787378307.680350:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+9:14246:x1874201626631936:12345-0@lo:502:llog_process_th.0 Request processed in 508us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378307.680359:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787378307.680446:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14246:1874201626631936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787378307.680477:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378307.680483:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378307.680485:0:14246:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787378307.680489:0:14246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1787378307.680649:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626631808:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787378307.680680:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874201626631808 offset 0 length 520: 4 00000020:01000000:3.0:1787378307.681437:0:14210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787378307.681473:0:14210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787378307.681487:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04e00/0xdd3c5462d7853c80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c87 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.681497:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04e00/0xdd3c5462d7853c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c87 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378307.681513:0:14210:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9eebbc37f000 from 1 10000000:01000000:3.0:1787378307.681516:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787378307.681545:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.681553:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.681562:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378307.681579:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787378307.681614:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378307.681645:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb90b43f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378307.681692:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626632064 00000100:00100000:1.0:1787378307.681698:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626632064 00000100:00100000:1.0:1787378307.681777:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787378307.681785:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+9:14210:x1874201626632064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787378307.681795:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378307.681810:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853cfe expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.681830:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.681841:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.681850:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641400, rc 0) 00000100:00100000:1.0:1787378307.681883:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+10:14210:x1874201626632064:12345-0@lo:101:mount.lustre.0 Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378307.681889:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787378307.682688:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378307.682707:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.682741:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378307.683454:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632192:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787378307.683524:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378307.683562:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb90b43f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787378307.683776:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626632192 00000100:00100000:0.0:1787378307.683782:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626632192 00000100:00100000:0.0:1787378307.683818:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787378307.683825:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+10:14210:x1874201626632192:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787378307.683843:0:14220:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787378307.683848:0:14220:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787378307.683919:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+10:14210:x1874201626632192:12345-0@lo:256:mount.lustre.0 Request processed in 93us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378307.683926:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378307.684060:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632192:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787378307.684621:0:14210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787378307.684643:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.684653:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378307.684660:0:14210:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebbc37f000 from 1 10000000:01000000:2.0:1787378307.684663:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787378307.684692:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.684700:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.684708:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378307.684744:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787378307.684794:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.684819:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da900 going to sleep for 11 seconds 00000100:00100000:1.0:1787378307.685261:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626632320 00000100:00100000:1.0:1787378307.685267:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626632320 00000100:00100000:1.0:1787378307.685306:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787378307.685313:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+10:14210:x1874201626632320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787378307.685323:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378307.685347:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853d0c expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.685369:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 11 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.685379:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 11 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.685387:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641e00, rc 0) 00000100:00100000:1.0:1787378307.685421:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14210:x1874201626632320:12345-0@lo:101:mount.lustre.0 Request processed in 108us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378307.685426:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787378307.685664:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787378307.685677:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.685685:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378307.685915:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378307.685943:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.686001:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da900 going to sleep for 11 seconds 00000100:00100000:1.0:1787378307.693565:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626632448 00000100:00100000:1.0:1787378307.693582:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626632448 00000100:00100000:1.0:1787378307.693651:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787378307.693661:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14210:x1874201626632448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787378307.694238:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14210:x1874201626632448:12345-0@lo:501:mount.lustre.0 Request processed in 576us (8291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378307.694246:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787378307.695783:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378307.695845:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787378307.695911:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.695943:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.695960:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626632576 00000100:00100000:2.0:1787378307.695965:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626632576 00000100:00100000:2.0:1787378307.696005:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787378307.696013:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14210:x1874201626632576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787378307.696195:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14210:x1874201626632576:12345-0@lo:503:mount.lustre.0 Request processed in 181us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.696202:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787378307.696249:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787378307.696445:0:14254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14254:1874201626632704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378307.696477:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.696495:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626632704 00000100:00100000:2.0:1787378307.696499:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626632704 00000100:00100000:2.0:1787378307.696530:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787378307.696535:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14254:x1874201626632704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378307.696691:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14254:x1874201626632704:12345-0@lo:502:llog_process_th.0 Request processed in 154us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.696706:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787378307.696756:0:14254:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da300 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.696768:0:14254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14254:1874201626632704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378307.696788:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378307.696796:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.696799:0:14254:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787378307.696806:0:14254:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eebbc37f000 00000020:00000080:2.0:1787378307.696808:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787378307.696815:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378307.696818:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.696819:0:14254:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787378307.696821:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378307.696823:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.696824:0:14254:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787378307.696827:0:14254:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eebbc37f000 00000020:00000080:2.0:1787378307.696829:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787378307.696876:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378307.696879:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.696881:0:14254:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787378307.696883:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787378307.696885:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.696887:0:14254:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787378307.696890:0:14254:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eebbc37f000 00000020:00000080:2.0:1787378307.696892:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787378307.696922:0:14254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14254:1874201626632832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378307.696953:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.696971:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626632832 00000100:00100000:2.0:1787378307.696975:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626632832 00000100:00100000:2.0:1787378307.696998:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787378307.697003:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14254:x1874201626632832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787378307.697109:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14254:x1874201626632832:12345-0@lo:502:llog_process_th.0 Request processed in 105us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.697116:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787378307.697144:0:14254:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da300 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.697155:0:14254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14254:1874201626632832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787378307.697171:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787378307.697175:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787378307.697177:0:14254:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787378307.697181:0:14254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787378307.697229:0:14210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787378307.697245:0:14210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787378307.697260:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.697271:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378307.697305:0:14210:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787378307.697308:0:14210:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eebbc37f000 10000000:01000000:2.0:1787378307.697311:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eebbc37f000 10000000:01000000:2.0:1787378307.697316:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787378307.697321:0:14210:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eebbc37f000 from 1 10000000:01000000:2.0:1787378307.697324:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787378307.697344:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0200/0xdd3c5462d7853d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.697353:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0200/0xdd3c5462d7853d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.697372:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0200/0xdd3c5462d7853d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378307.697385:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787378307.697410:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.697424:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da840 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.697442:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626632960 00000100:00100000:2.0:1787378307.697446:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626632960 00000100:00100000:2.0:1787378307.697466:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787378307.697473:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14210:x1874201626632960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787378307.697481:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378307.697492:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc0600/0xdd3c5462d7853d21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853d1a expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.697534:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc0600/0xdd3c5462d7853d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853d1a expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.697545:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc0600/0xdd3c5462d7853d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d1a expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.697554:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0600, rc 0) 00000100:00100000:2.0:1787378307.697581:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14210:x1874201626632960:12345-0@lo:101:mount.lustre.0 Request processed in 108us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.697587:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787378307.697617:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626632960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787378307.697629:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0200/0xdd3c5462d7853d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d21 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.697645:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0200/0xdd3c5462d7853d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853d21 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378307.697689:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626633088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378307.697713:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.697746:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da840 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.697758:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626633088 00000100:00100000:2.0:1787378307.697761:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626633088 00000100:00100000:2.0:1787378307.697781:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787378307.697786:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14210:x1874201626633088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378307.697976:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14210:x1874201626633088:12345-0@lo:501:mount.lustre.0 Request processed in 188us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.697983:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787378307.698013:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626633088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378307.698036:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626633216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787378307.698067:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.698079:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da840 going to sleep for 11 seconds 00000100:00100000:2.0:1787378307.698091:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626633216 00000100:00100000:2.0:1787378307.698094:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626633216 00000100:00100000:2.0:1787378307.698112:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787378307.698117:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14210:x1874201626633216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787378307.698234:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14210:x1874201626633216:12345-0@lo:503:mount.lustre.0 Request processed in 115us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.698240:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787378307.698282:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626633216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787378307.712470:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14255:1874201626633344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378307.712559:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378307.720011:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb600 going to sleep for 11 seconds 00000100:00100000:3.0:1787378307.731046:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626633344 00000100:00100000:3.0:1787378307.731061:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626633344 00000100:00100000:1.0:1787378307.731686:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787378307.731698:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14255:x1874201626633344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378307.732015:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14255:x1874201626633344:12345-0@lo:502:llog_process_th.0 Request processed in 319us (19455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378307.732216:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787378307.732286:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14255:1874201626633344:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787378307.732353:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787378307.732368:0:14255:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9eeb88278000) 00000020:00000080:1.0:1787378307.732387:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787378307.732553:0:14255:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eebbc37f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787378307.732558:0:14255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eebbc37f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787378307.732560:0:14255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eebbc37f000 4 00010000:00080000:1.0:1787378307.732587:0:14255:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eeb82c6f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1787378307.747428:0:14255:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787378307.747564:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787378307.747602:0:14255:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787378307.747616:0:14255:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdd3c5462d7853d2f 00000100:00080000:1.0:1787378307.747626:0:14255:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787378307.747632:0:14255:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9eeb82c6f800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787378307.747665:0:14255:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae6fa680 x1874201626633472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787378307.747712:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626633472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787378307.747875:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787378307.747935:0:14255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787378307.747986:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787378307.747991:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787378307.747993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787378307.747996:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787378307.748047:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3311:1874201626633600:0@lo:400:kworker.0 00000100:00100000:1.0:1787378307.748081:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378307.748137:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626633600 00000100:00100000:1.0:1787378307.748144:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626633600 00000100:00100000:1.0:1787378307.748181:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787378307.748189:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:3311:x1874201626633600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378307.748235:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:3311:x1874201626633600:12345-0@lo:400:kworker.0 Request processed in 46us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378307.748242:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787378307.748284:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3311:1874201626633600:0@lo:400:kworker.0 00000100:00100000:3.0:1787378307.750080:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626633472 00000100:00100000:3.0:1787378307.750093:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626633472 00000100:00100000:3.0:1787378307.750126:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787378307.750133:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874201626633472:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787378307.750209:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874201626633472:12345-0@lo:38:llog_process_th.0 Request processed in 75us (2333us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787378307.750215:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787378307.750268:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787378307.750275:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eeb82c6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787378307.750279:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787378307.750283:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626633472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787378307.761672:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14255:1874201626633728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378307.761772:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378307.761810:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626633728 00000100:00100000:1.0:1787378307.761816:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626633728 00000100:00100000:1.0:1787378307.761855:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787378307.761864:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14255:x1874201626633728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787378307.762102:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14255:x1874201626633728:12345-0@lo:502:llog_process_th.0 Request processed in 238us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378307.762110:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787378307.762158:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787378307.762179:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14255:1874201626633728:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787378307.762202:0:14255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787378307.762581:0:14210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787378307.762603:0:14210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787378307.762618:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0200/0xdd3c5462d7853d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d21 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.762630:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0200/0xdd3c5462d7853d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d21 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787378307.762674:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787378307.762676:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787378307.762677:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787378307.762679:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787378307.762680:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787378307.762682:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787378307.762683:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787378307.762685:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787378307.762686:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787378307.762688:0:14210:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787378307.762691:0:14210:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787378307.762694:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787378307.762695:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787378307.762696:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787378307.762698:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787378307.762699:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787378307.762700:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787378307.762701:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787378307.762702:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787378307.762704:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787378307.762705:0:14210:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787378307.762741:0:14210:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787378307.762755:0:14210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626633856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787378307.762789:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.762810:0:14210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da300 going to sleep for 11 seconds 00000100:00100000:1.0:1787378307.763496:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626633856 00000100:00100000:1.0:1787378307.763513:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626633856 00000100:00100000:1.0:1787378307.763553:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787378307.763567:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14210:x1874201626633856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787378307.763591:0:14220:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787378307.763604:0:14220:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787378307.860243:0:14220:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787378307.860261:0:14220:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787378307.860450:0:14244:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787378307.860455:0:14244:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787378307.860488:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.860515:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 12 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.860524:0:14244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.860563:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 12 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378307.860576:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 12 pid: 14223 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378307.860604:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1874201626633984:0@lo:104: 00000100:00100000:3.0:1787378307.860665:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378307.860745:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf6ee600 going to sleep for 11 seconds 00000100:00100000:1.0:1787378307.860949:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626633984 00000100:00100000:1.0:1787378307.860957:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626633984 00000100:00100000:1.0:1787378307.861005:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787378307.861014:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:14244:x1874201626633984:12345-0@lo:104: 00010000:00010000:1.0:1787378307.861037:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378307.861093:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378307.861099:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:14244:x1874201626633984:12345-0@lo:104: Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378307.861106:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787378307.861261:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1874201626633984:0@lo:104: 00010000:00010000:3.0:1787378307.861279:0:14244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861407:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787378307.861420:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861426:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:2.0:1787378307.861430:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861437:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787378307.861444:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378307.861468:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787378307.861514:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861520:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787378307.861546:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861554:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd04600/0xdd3c5462d7853cfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d05 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861569:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378307.861571:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378307.861572:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378307.861580:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378307.861591:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae276680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3311:1874201626634112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378307.861623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378307.861668:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626634112 00000100:00100000:2.0:1787378307.861677:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626634112 00010000:00010000:2.0:1787378307.861694:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 13 pid: 14223 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378307.861714:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378307.861743:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+13:3311:x1874201626634112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378307.861753:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378307.861921:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 13 pid: 14223 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861933:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 13 pid: 14223 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861946:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7853cfe expref: 13 pid: 14223 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861959:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861967:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787378307.861981:0:14213:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001526799s 00010000:00010000:2.0:1787378307.861985:0:14213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.861993:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.862000:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.862017:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.862035:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378307.862039:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.862047:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378307.873898:0:14244:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378307.873916:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.874863:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.874879:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04800/0xdd3c5462d7853d36 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378307.874900:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378307.874980:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:3311:x1874201626634112:12345-0@lo:103:ldlm_bl.0 Request processed in 13234us (13352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378307.874990:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787378307.875101:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae276680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3311:1874201626634112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787378307.886570:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14210:x1874201626633856:12345-0@lo:253:mount.lustre.0 Request processed in 122993us (123770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378307.886586:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787378307.886860:0:14210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14210:1874201626633856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787378307.886874:0:14210:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787378307.886877:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787378307.886878:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787378307.886880:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787378307.886881:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787378307.886883:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787378307.886884:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787378307.886885:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787378307.886886:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787378307.886901:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787378307.886903:0:14210:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787378307.886923:0:14210:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787378307.899698:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378307.900621:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378307.901018:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378307.901190:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378307.901464:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378307.901637:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378307.908637:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378307.909455:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378307.910989:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787378307.918999:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787378307.919283:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787378307.919438:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787378307.941251:0:14210:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787378307.941860:0:14210:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787378307.942002:0:14266:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787378307.942006:0:14266:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787378307.942207:0:14267:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787378307.942280:0:14267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787378307.947449:0:14267:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787378307.947547:0:14267:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787378307.947552:0:14267:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1787378307.950008:0:14210:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787378307.950160:0:14210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787378307.950672:0:14210:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787378307.950680:0:14210:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787378307.951093:0:14210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787378307.952254:0:14210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787378307.952996:0:14210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787378307.953030:0:14210:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787378307.955006:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787378307.961465:0:14210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787378308.027048:0:14210:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787378308.027089:0:14210:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb59a016df988 00100000:10000000:1.0:1787378308.027099:0:14210:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787378308.028564:0:14210:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787378308.028654:0:14210:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787378308.028670:0:14210:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787378308.028695:0:14210:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787378308.123552:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787378308.765131:0:14225:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787378308.765138:0:14225:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9eebbc37f000 from 6 10000000:01000000:3.0:1787378308.765143:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787378308.765190:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378308.765202:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378308.765212:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378308.765237:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626634240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787378308.765302:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378308.765354:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb51da900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378308.765606:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626634240 00000100:00100000:2.0:1787378308.765614:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626634240 00000100:00100000:2.0:1787378308.765664:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787378308.765673:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14225:x1874201626634240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378308.765686:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378308.765701:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853d3d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378308.765744:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378308.765756:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378308.765764:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1e00, rc 0) 00000100:00100000:2.0:1787378308.765810:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14225:x1874201626634240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378308.765817:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787378308.765860:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626634240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378308.765877:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378308.765896:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378308.765944:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626634368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787378308.765976:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378308.765993:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8c59840 going to sleep for 11 seconds 00000100:00100000:2.0:1787378308.766005:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626634368 00000100:00100000:2.0:1787378308.766008:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626634368 00000100:00100000:2.0:1787378308.766029:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787378308.766035:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14225:x1874201626634368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787378308.766047:0:14220:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787378308.766062:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787378308.766065:0:14220:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787378308.766139:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14225:x1874201626634368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378308.766146:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787378308.766175:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626634368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787378308.766214:0:14225:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787378308.766221:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378308.766229:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787378308.826516:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787378309.163855:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787378309.859951:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787378310.174426:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378311.194519:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378312.222007:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378313.253247:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787378313.253660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787378313.253665:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787378313.253668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787378313.253678:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787378313.253681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787378313.253684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787378313.253688:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eeb82c6f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787378313.253699:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9eeb82c6f800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787378313.253744:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebad2e3800 x1874201626634624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787378313.253974:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626634496:0@lo:400:kworker.0 00000100:00100000:2.0:1787378313.269383:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626634624:0@lo:38:kworker.0 00000100:00100000:2.0:1787378313.269499:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378313.269796:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626634624 00000100:00100000:3.0:1787378313.269804:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626634624 00000100:00100000:3.0:1787378313.269838:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787378313.269847:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874201626634624:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787378313.269875:0:14230:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:3.0:1787378313.269916:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdd3c5462d7853d4b 00000004:00100000:3.0:1787378313.269931:0:14230:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787378313.270069:0:14230:0:(import.c:65:import_set_state_nolock()) ffff9eebbc253000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787378313.270122:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874201626634624:12345-0@lo:38:kworker.0 Request processed in 274us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378313.270129:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787378313.270547:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eebad2e3800 x1874201626634624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787378323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787378313.270564:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787378313.270571:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787378313.270576:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787378313.270578:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eeb82c6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787378313.270585:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874201626634624:0@lo:38:kworker.0 00000100:00100000:1.0:1787378313.273694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378313.276948:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626634496 00000100:00100000:2.0:1787378313.276963:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626634496 00000100:00100000:2.0:1787378313.277044:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787378313.277054:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:3313:x1874201626634496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378313.277143:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:3313:x1874201626634496:12345-0@lo:400:kworker.0 Request processed in 90us (23106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378313.277151:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787378313.277250:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626634496:0@lo:400:kworker.0 00000001:02000400:2.0:1787378313.933694:0:14510:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787378314.266032:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378315.290589:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378316.314075:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787378317.014820:0:14660:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc9ef5b8e0 00000020:00000080:1.0:1787378317.014840:0:14660:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787378317.014855:0:14660:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787378317.014868:0:14660:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9ef5db70 20000000:00000080:1.0:1787378317.014874:0:14660:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eebb51afc00 uarg=0000000000000000 20000000:01000000:1.0:1787378317.014909:0:14660:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787378317.014917:0:14660:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787378317.014922:0:14660:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787378317.015911:0:14661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787378317.016758:0:14660:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787378317.024776:0:14660:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787378317.024866:0:14660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.024885:0:14660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 11 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.024894:0:14660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.024936:0:14660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 11 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.024952:0:14660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 11 pid: 14223 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378317.024966:0:14660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14660:1874201626634752:0@lo:104: 00000100:00100000:0.0:1787378317.025028:0:14660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378317.025080:0:14660:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb900c7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378317.025164:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626634752 00000100:00100000:1.0:1787378317.025172:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626634752 00000100:00100000:1.0:1787378317.025224:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787378317.025233:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:14660:x1874201626634752:12345-0@lo:104: 00010000:00010000:1.0:1787378317.025245:0:14212:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378317.025299:0:14212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378317.025306:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:14660:x1874201626634752:12345-0@lo:104: Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378317.025313:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787378317.025565:0:14660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14660:1874201626634752:0@lo:104: 00010000:00010000:0.0:1787378317.025583:0:14660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026070:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378317.026077:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026086:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1600 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:0.0:1787378317.026090:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026099:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787378317.026107:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378317.026124:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787378317.026162:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026169:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787378317.026195:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026203:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1600/0xdd3c5462d7853d0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d13 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026224:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378317.026226:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378317.026228:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378317.026269:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378317.026283:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626634880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378317.026323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378317.026509:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626634880 00000100:00100000:0.0:1787378317.026522:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626634880 00010000:00010000:0.0:1787378317.026543:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 12 pid: 14223 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378317.026575:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787378317.026583:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:3313:x1874201626634880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378317.026595:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378317.026601:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 12 pid: 14223 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026613:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 12 pid: 14223 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026628:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7853d13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7853d0c expref: 12 pid: 14223 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026644:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026654:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026668:0:14213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026675:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026683:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026689:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026909:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378317.026914:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026922:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026935:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.026945:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378317.026980:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:3313:x1874201626634880:12345-0@lo:103:ldlm_bl.0 Request processed in 398us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378317.026988:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787378317.027013:0:14660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.027021:0:14660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378317.027027:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128aa00/0xdd3c5462d7853d52 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378317.028797:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626634880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378317.338267:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378317.338821:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787378307/real 1787378307] req@ffff9eebae274000 x1874201626631808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787378317 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378317.338853:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eebae274000 x1874201626631808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787378317 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378317.338910:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787378307/real 1787378307] req@ffff9eebbb722d80 x1874201626631680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787378317 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378317.338923:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eebbb722d80 x1874201626631680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787378317 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787378317.338941:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787378317.338982:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787378317.338986:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626631808:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787378317.338992:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebad27c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787378317.338997:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787378317.339000:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626631680:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787378317.339087:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787378317.339092:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787378317.339095:0:478:0:(import.c:65:import_set_state_nolock()) ffff9eebad27c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787378317.339100:0:478:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787378317.339118:0:478:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787378317.339133:0:478:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eebad27c000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787378317.339164:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebad2e1880 x1874201626635008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787378317.339189:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787378317.339192:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787378317.339194:0:478:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787378317.339197:0:478:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787378317.339199:0:478:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787378317.339202:0:478:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eebbc248800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787378317.339214:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebad2e2d80 x1874201626635136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787378317.339298:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626635264:0@lo:400:kworker.0 00000100:00100000:2.0:1787378317.339359:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378317.339607:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626635264 00000100:00100000:1.0:1787378317.339615:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626635264 00000100:00100000:1.0:1787378317.339670:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787378317.339679:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626635264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378317.339928:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626635008:0@lo:8:kworker.0 00000400:00000100:3.0:1787378317.339956:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874201626635008 offset 0 length 520: 4 00000100:00100000:3.0:1787378317.339978:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626635136:0@lo:8:kworker.0 00000400:00000100:3.0:1787378317.339997:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874201626635136 offset 0 length 520: 4 00000100:00100000:1.0:1787378317.345916:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626635264:12345-0@lo:400:kworker.0 Request processed in 6224us (6544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378317.345934:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787378317.346367:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eebad2e3b80 x1874201626635264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378317.346402:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626635264:0@lo:400:kworker.0 00010000:00010000:0.0:1787378318.372269:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787378318.427418:0:14225:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787378318.427425:0:14225:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebbc37f000 from 10 10000000:01000000:2.0:1787378318.427442:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787378318.427492:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378318.427505:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378318.427516:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378318.427540:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626635392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787378318.427610:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378318.427662:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378318.427744:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626635392 00000100:00100000:1.0:1787378318.427752:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626635392 00000100:00100000:1.0:1787378318.427813:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787378318.427822:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+11:14225:x1874201626635392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378318.427835:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378318.427849:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853d59 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378318.427872:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 12 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378318.427883:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 12 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378318.427891:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641600, rc 0) 00000100:00100000:1.0:1787378318.427932:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14225:x1874201626635392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378318.427939:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787378318.428144:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626635392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378318.428159:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378318.428167:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378318.428232:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626635520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378318.428260:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378318.428292:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378318.428444:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626635520 00000100:00100000:1.0:1787378318.428449:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626635520 00000100:00100000:1.0:1787378318.428482:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787378318.428489:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14225:x1874201626635520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787378318.428758:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14225:x1874201626635520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378318.428765:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787378318.435206:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626635520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378318.435287:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626635648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378318.435359:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378318.435403:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb913a36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378318.436346:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626635648 00000100:00100000:3.0:1787378318.436357:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626635648 00000100:00100000:3.0:1787378318.436456:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787378318.436466:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14225:x1874201626635648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378318.436698:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14225:x1874201626635648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378318.436707:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787378318.436840:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626635648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787378318.438635:0:14719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787378318.438944:0:14225:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787378318.438962:0:14225:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787378318.438974:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378318.438987:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787378319.067331:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787378319.387589:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378320.410037:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378321.438814:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787378321.616941:0:14862:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787378321.616945:0:14862:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787378321.617085:0:14862:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9eeb88272800 00000020:01000004:1.0:1787378321.618904:0:14862:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787378321.618917:0:14862:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787378321.618932:0:14862:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9eeb87790000) 00000020:00000080:1.0:1787378321.618949:0:14862:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787378321.660674:0:14862:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787378321.660956:0:14862:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787378321.661814:0:14862:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787378321.662042:0:14862:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787378321.662247:0:14862:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787378321.662840:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 441: rc = 0 00100000:10000000:1.0:1787378321.662936:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 441: rc = 0 00100000:10000000:1.0:1787378321.663030:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 441: rc = 0 00100000:10000000:1.0:1787378321.666391:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 643: rc = 0 00100000:10000000:1.0:1787378321.667208:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:1.0:1787378321.667474:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:1.0:1787378321.667943:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 643: rc = 0 00100000:10000000:1.0:1787378321.668364:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 643: rc = 0 00100000:10000000:1.0:1787378321.668612:0:14862:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 643: rc = 0 00000020:00000080:1.0:1787378321.672065:0:14862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787378321.672078:0:14862:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787378321.672088:0:14862:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdd3c5462d7853d6e 00000020:01000004:1.0:1787378321.672161:0:14862:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787378321.672181:0:14862:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787378321.672184:0:14862:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787378321.672189:0:14862:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787378321.672194:0:14862:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787378321.672203:0:14862:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9eeb877919c0) 00000020:00000080:1.0:1787378321.672212:0:14862:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1787378321.674556:0:14862:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787378321.674750:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787378321.674756:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787378321.676239:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787378321.676249:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787378321.676913:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787378321.676926:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787378321.678592:0:14862:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378321.678783:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787378321.678789:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787378321.680167:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787378321.680177:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787378321.728246:0:14862:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378321.728487:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787378321.728493:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787378321.734322:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787378321.734335:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787378321.741065:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787378321.741082:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787378321.751075:0:14862:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787378321.751264:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787378321.751270:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787378321.754536:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787378321.754549:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787378321.836332:0:14862:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787378321.836701:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787378321.836708:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787378321.839176:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787378321.839190:0:14862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787378321.841328:0:14862:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787378321.841354:0:14862:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787378321.841360:0:14862:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787378321.855340:0:14862:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787378321.855380:0:14862:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787378321.855385:0:14862:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787378321.855387:0:14862:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787378321.855389:0:14862:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378321.855390:0:14862:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378321.855391:0:14862:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378321.855393:0:14862:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378321.855395:0:14862:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378321.855396:0:14862:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378321.855398:0:14862:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787378321.855401:0:14862:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787378321.855404:0:14862:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787378321.855405:0:14862:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787378321.855416:0:14862:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378321.855417:0:14862:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378321.855418:0:14862:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378321.855420:0:14862:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378321.855421:0:14862:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378321.855422:0:14862:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378321.855423:0:14862:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787378321.855448:0:14862:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787378321.855468:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626635776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787378321.855545:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378321.855673:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378321.855715:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626635776 00000100:00100000:2.0:1787378321.855753:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626635776 00000100:00100000:2.0:1787378321.855803:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787378321.855812:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14862:x1874201626635776:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787378321.855841:0:14223:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787378321.855844:0:14223:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787378321.855849:0:14223:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787378321.867298:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14862:x1874201626635776:12345-0@lo:253:mount.lustre.0 Request processed in 11479us (11744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378321.867313:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787378321.867456:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626635776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787378321.867471:0:14862:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787378321.867475:0:14862:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787378321.867476:0:14862:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787378321.867477:0:14862:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787378321.867479:0:14862:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787378321.867480:0:14862:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787378321.867481:0:14862:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787378321.867483:0:14862:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787378321.867484:0:14862:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787378321.867486:0:14862:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787378321.867507:0:14862:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eeb88272800 from lustre-OST0000 10000000:01000000:3.0:1787378321.867554:0:14862:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787378321.867558:0:14862:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787378321.867564:0:14862:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eeb883b3380 local copy 00010000:00010000:3.0:1787378321.867575:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378321.868280:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626635904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378321.868334:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378321.868489:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb894b0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787378321.868533:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626635904 00000100:00100000:2.0:1787378321.868539:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626635904 00000100:00100000:2.0:1787378321.868614:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787378321.868623:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14862:x1874201626635904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378321.868806:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14862:x1874201626635904:12345-0@lo:501:mount.lustre.0 Request processed in 183us (471us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787378321.868814:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787378321.868880:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626635904:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787378321.868906:0:14862:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787378321.869049:0:14862:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787378321.869057:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.869067:0:14862:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378321.869309:0:14862:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eeb88272800 10000000:01000000:3.0:1787378321.869315:0:14862:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787378321.869320:0:14862:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9eeb883b3380 10000000:01000000:3.0:1787378321.869322:0:14862:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787378321.869325:0:14862:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9eeb883b3380 from 1 10000000:01000000:3.0:1787378321.869329:0:14862:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787378321.869355:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05000/0xdd3c5462d7853d7c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.869376:0:14862:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05000/0xdd3c5462d7853d7c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.869386:0:14862:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05000/0xdd3c5462d7853d7c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378321.869401:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787378321.869440:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378321.869925:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb894b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787378321.870134:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626636032 00000100:00100000:1.0:1787378321.870140:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626636032 00000100:00100000:1.0:1787378321.870171:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787378321.870179:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+12:14862:x1874201626636032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787378321.870198:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378321.870214:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf641a00/0xdd3c5462d7853d83 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853d7c expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.870234:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641a00/0xdd3c5462d7853d83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853d7c expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.870243:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf641a00/0xdd3c5462d7853d83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d7c expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.870252:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641a00, rc 0) 00000100:00100000:1.0:1787378321.870292:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+13:14862:x1874201626636032:12345-0@lo:101:mount.lustre.0 Request processed in 114us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378321.870298:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787378321.873627:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378321.873656:0:14862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05000/0xdd3c5462d7853d7c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d83 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.873678:0:14862:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05000/0xdd3c5462d7853d7c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853d83 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378321.873702:0:14862:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787378321.873763:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05000/0xdd3c5462d7853d7c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d83 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.873771:0:14862:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05000/0xdd3c5462d7853d7c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d83 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378321.873779:0:14862:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787378321.873787:0:14862:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787378321.873794:0:14862:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787378321.873796:0:14862:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787378321.873825:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05800/0xdd3c5462d7853d8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.873832:0:14862:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05800/0xdd3c5462d7853d8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.873840:0:14862:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05800/0xdd3c5462d7853d8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378321.873858:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787378321.873922:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378321.873970:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb894b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787378321.874266:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626636160 00000100:00100000:1.0:1787378321.874273:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626636160 00000100:00100000:1.0:1787378321.874311:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787378321.874319:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+13:14862:x1874201626636160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787378321.874331:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378321.874343:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853d8a expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.874363:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853d8a expref: 14 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.874373:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf641400/0xdd3c5462d7853d91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d8a expref: 14 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.874381:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641400, rc 0) 00000100:00100000:1.0:1787378321.874437:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636160:12345-0@lo:101:mount.lustre.0 Request processed in 118us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378321.874443:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787378321.874592:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378321.874605:0:14862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05800/0xdd3c5462d7853d8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d91 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.874613:0:14862:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05800/0xdd3c5462d7853d8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853d91 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787378321.877021:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787378321.878243:0:14862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787378321.878505:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787378321.878551:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787378321.878585:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787378321.878632:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787378321.878683:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787378321.878715:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787378321.879084:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787378321.879154:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787378321.879244:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378321.879309:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378321.879364:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84565b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787378321.879488:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626636288 00000100:00100000:2.0:1787378321.879496:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626636288 00000100:00100000:2.0:1787378321.879543:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787378321.879552:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378321.880256:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636288:12345-0@lo:501:mount.lustre.0 Request processed in 704us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378321.880272:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787378321.880492:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787378321.880533:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787378321.880575:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378321.880649:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787378321.880949:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626636416 00000100:00100000:1.0:1787378321.880957:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626636416 00000100:00100000:1.0:1787378321.881032:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787378321.881040:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787378321.881380:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636416:12345-0@lo:503:mount.lustre.0 Request processed in 341us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378321.881388:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787378321.881482:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636416:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787378321.882987:0:14862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787378321.883076:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787378321.883286:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378321.883325:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb600 going to sleep for 11 seconds 00000100:00100000:3.0:1787378321.883386:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626636544 00000100:00100000:3.0:1787378321.883392:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626636544 00000100:00100000:3.0:1787378321.883441:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787378321.883450:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787378321.883660:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636544:12345-0@lo:502:mount.lustre.0 Request processed in 210us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378321.883773:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787378321.884133:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787378321.884184:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787378321.884220:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787378321.884271:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787378321.884309:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787378321.884343:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787378321.884390:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787378321.884442:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787378321.884476:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787378321.884522:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787378321.884555:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787378321.884600:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787378321.884633:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787378321.884691:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378321.884998:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787378321.885037:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626636672 00000100:00100000:3.0:1787378321.885046:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626636672 00000100:00100000:3.0:1787378321.885072:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787378321.885080:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787378321.885245:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636672:12345-0@lo:502:mount.lustre.0 Request processed in 164us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378321.885251:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787378321.885349:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb97cbb600 going to sleep for 11 seconds 00000100:00100000:0.0:1787378321.885367:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787378321.885446:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787378321.885458:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787378321.897067:0:14876:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787378321.897080:0:14876:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787378321.897153:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378321.897170:0:14876:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787378321.897178:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787378321.897198:0:14876:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9eebb53819c0) 00000020:00000080:0.0:1787378321.897224:0:14876:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787378321.897230:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787378321.897315:0:14876:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eeb88272800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787378321.897322:0:14876:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787378321.897331:0:14876:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdd3c5462d7853d9f 00010000:00010000:0.0:1787378321.903590:0:14876:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787378321.904303:0:14876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787378321.912509:0:14876:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787378321.919419:0:14876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787378321.919431:0:14876:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378321.919438:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.919440:0:14876:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787378321.919445:0:14876:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787378321.919448:0:14876:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787378321.919449:0:14876:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787378321.919451:0:14876:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787378321.919452:0:14876:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787378321.919455:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.919456:0:14876:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787378321.919459:0:14876:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378321.919462:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.919463:0:14876:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787378321.919466:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787378321.919468:0:14876:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787378321.919470:0:14876:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378321.919472:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.919474:0:14876:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787378321.919476:0:14876:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378321.919478:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.919479:0:14876:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787378321.919490:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787378321.919556:0:14876:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378321.919560:0:14876:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.919561:0:14876:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787378321.919564:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787378321.919768:0:14862:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787378321.919797:0:14862:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787378321.919813:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05800/0xdd3c5462d7853d8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d91 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378321.919825:0:14862:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05800/0xdd3c5462d7853d8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853d91 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378321.919833:0:14862:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb88272800 from 1 10000000:01000000:0.0:1787378321.919836:0:14862:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787378321.919870:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378321.919879:0:14862:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378321.919900:0:14862:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378321.919924:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787378321.920009:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378321.920043:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8683780 going to sleep for 11 seconds 00000100:00100000:3.0:1787378321.923630:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626636800 00000100:00100000:3.0:1787378321.923646:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626636800 00000100:00100000:3.0:1787378321.923742:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787378321.923762:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+14:14862:x1874201626636800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378321.923779:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378321.923796:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853da6 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.923822:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 15 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.923833:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 15 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378321.923843:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04400, rc 0) 00000100:00100000:3.0:1787378321.932048:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626636800:12345-0@lo:101:mount.lustre.0 Request processed in 8119us (11870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378321.932063:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787378321.932190:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787378321.932212:0:14862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378321.932227:0:14862:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787378321.935339:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787378321.937309:0:14862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787378321.937673:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787378321.938373:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787378321.938477:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787378321.938485:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787378321.938577:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378321.938637:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378321.938683:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9e0929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378321.938898:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626636928 00000100:00100000:1.0:1787378321.938905:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626636928 00000100:00100000:1.0:1787378321.938949:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787378321.938969:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626636928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787378321.939199:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626636928:12345-0@lo:501:mount.lustre.0 Request processed in 240us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378321.939206:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787378321.939492:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626636928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378321.939527:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787378321.939567:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378321.939593:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9e0929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378321.939659:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626637056 00000100:00100000:0.0:1787378321.939674:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626637056 00000100:00100000:0.0:1787378321.939711:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787378321.939740:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626637056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787378321.940188:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626637056:12345-0@lo:503:mount.lustre.0 Request processed in 470us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378321.940195:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787378321.940273:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637056:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787378321.940848:0:14862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787378321.940923:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787378321.940978:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378321.941012:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9e0929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378321.941402:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626637184 00000100:00100000:1.0:1787378321.941419:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626637184 00000100:00100000:1.0:1787378321.941451:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787378321.941458:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626637184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787378321.941612:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626637184:12345-0@lo:502:mount.lustre.0 Request processed in 154us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378321.941619:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787378321.942043:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787378321.942321:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787378321.942370:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787378321.942431:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787378321.942467:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787378321.942497:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787378321.942540:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787378321.942572:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787378321.942612:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787378321.942643:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787378321.943080:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378321.943200:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9e0929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378321.944348:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626637312 00000100:00100000:1.0:1787378321.944358:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626637312 00000100:00100000:2.0:1787378321.944583:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787378321.944593:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626637312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787378321.944896:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626637312:12345-0@lo:502:mount.lustre.0 Request processed in 292us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378321.944905:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787378321.945013:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787378321.945173:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787378321.945201:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787378321.947177:0:14880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378321.947189:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.947191:0:14880:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787378321.947198:0:14880:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eeb88272800 00000020:00000080:1.0:1787378321.947201:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787378321.947207:0:14880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378321.947210:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.947211:0:14880:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787378321.947214:0:14880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378321.947223:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.947225:0:14880:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787378321.947229:0:14880:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eeb88272800 00000020:00000080:1.0:1787378321.947231:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787378321.947284:0:14880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378321.947288:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.947289:0:14880:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787378321.947292:0:14880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787378321.947294:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.947296:0:14880:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787378321.947299:0:14880:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eeb88272800 00000020:00000080:1.0:1787378321.947301:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787378321.947337:0:14880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787378321.947341:0:14880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787378321.947342:0:14880:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787378321.947345:0:14880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787378321.955795:0:14862:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787378321.955841:0:14862:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787378321.955862:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.955874:0:14862:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378321.955942:0:14862:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787378321.955945:0:14862:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eeb88272800 10000000:01000000:1.0:1787378321.955948:0:14862:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eeb88272800 10000000:01000000:1.0:1787378321.955952:0:14862:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787378321.955957:0:14862:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eeb88272800 from 1 10000000:01000000:1.0:1787378321.955970:0:14862:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787378321.956006:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf641c00/0xdd3c5462d7853db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.956024:0:14862:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebbf641c00/0xdd3c5462d7853db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.956036:0:14862:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebbf641c00/0xdd3c5462d7853db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378321.956060:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787378321.956126:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378321.958234:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207840 going to sleep for 11 seconds 00000100:00100000:2.0:1787378321.958292:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626637440 00000100:00100000:2.0:1787378321.958299:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626637440 00000100:00100000:2.0:1787378321.958392:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787378321.958403:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626637440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787378321.958431:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378321.958449:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc0a00/0xdd3c5462d7853dbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853db4 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378321.958475:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc0a00/0xdd3c5462d7853dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853db4 expref: 16 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378321.958487:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc0a00/0xdd3c5462d7853dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853db4 expref: 16 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378321.958497:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0a00, rc 0) 00000100:00100000:2.0:1787378321.958563:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637440:12345-0@lo:101:mount.lustre.0 Request processed in 163us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378321.958570:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787378321.962068:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787378321.962107:0:14862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebbf641c00/0xdd3c5462d7853db4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853dbb expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378321.962122:0:14862:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebbf641c00/0xdd3c5462d7853db4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853dbb expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787378321.962766:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787378321.963427:0:14862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787378321.963690:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787378321.963768:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787378321.963799:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787378321.963856:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787378321.966375:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787378321.966552:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787378321.966592:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787378321.966628:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787378321.966682:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787378321.966735:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787378321.966789:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787378321.966839:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787378321.966877:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787378321.967607:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787378321.967663:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787378321.967695:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787378321.967796:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787378321.967865:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787378321.968016:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787378321.968067:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787378321.968191:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787378321.968229:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787378321.968257:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787378321.968299:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787378321.968330:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787378321.968362:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787378321.968975:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787378321.969026:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787378321.969237:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787378321.969246:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787378321.969349:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787378321.969582:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378321.969630:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9a207840 going to sleep for 11 seconds 00000100:00100000:3.0:1787378321.969805:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626637568 00000100:00100000:3.0:1787378321.969818:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626637568 00000100:00100000:3.0:1787378321.969864:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787378321.969872:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378321.970306:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637568:12345-0@lo:501:mount.lustre.0 Request processed in 432us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378321.970315:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787378321.970400:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787378321.970452:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637696:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787378321.970492:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378321.970511:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb84491180 going to sleep for 11 seconds 00000100:00100000:0.0:1787378321.970525:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626637696 00000100:00100000:0.0:1787378321.970529:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626637696 00000100:00100000:0.0:1787378321.970561:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787378321.970568:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787378321.970711:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637696:12345-0@lo:503:mount.lustre.0 Request processed in 143us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378321.970743:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787378321.970787:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637696:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787378321.971551:0:14862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787378321.971615:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787378321.971661:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378321.971682:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378321.971701:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626637824 00000100:00100000:0.0:1787378321.971705:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626637824 00000100:00100000:0.0:1787378321.971750:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787378321.971756:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787378321.973254:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637824:12345-0@lo:502:mount.lustre.0 Request processed in 1492us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378321.973266:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787378321.973341:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787378321.975244:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787378321.975330:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787378321.975365:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787378321.975426:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787378321.975464:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787378321.975525:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787378321.975559:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787378321.975589:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787378321.975647:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787378321.975685:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787378321.975715:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787378321.975786:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787378321.975823:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787378321.975874:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787378321.975935:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787378321.978251:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787378321.978330:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787378321.978396:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787378321.978442:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787378321.978472:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787378321.978514:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787378321.978561:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787378321.978591:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787378321.978644:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787378321.978686:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787378321.981984:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787378321.982264:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787378321.982300:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787378321.982328:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787378321.982370:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787378321.982421:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787378321.982457:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787378321.982491:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787378321.982541:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787378321.982578:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787378321.982627:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787378321.982664:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787378321.982748:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787378321.982802:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787378321.982842:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787378321.985053:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787378321.985244:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378321.985284:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378321.985425:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626637952 00000100:00100000:3.0:1787378321.985433:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626637952 00000100:00100000:3.0:1787378321.985473:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787378321.985481:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787378321.985713:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626637952:12345-0@lo:502:mount.lustre.0 Request processed in 231us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378321.985737:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787378321.985862:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626637952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787378321.986182:0:14862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787378321.986199:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787378321.997455:0:14885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787378321.997472:0:14885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9eeb87793380) 00000020:00000080:1.0:1787378321.997494:0:14885:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787378322.006797:0:14885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eeb88272800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787378322.006808:0:14885:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eeb88272800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787378322.006811:0:14885:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eeb88272800 3 00010000:00080000:1.0:1787378322.006846:0:14885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eeb9a1e0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1787378322.013295:0:14885:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787378322.013427:0:14885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787378322.013464:0:14885:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787378322.013476:0:14885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdd3c5462d7853dc9 00000100:00080000:1.0:1787378322.013487:0:14885:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787378322.013493:0:14885:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eeb9a1e0000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787378322.013525:0:14885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae6f8700 x1874201626638080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787378322.013550:0:14885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787378322.014444:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874201626638080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787378322.014519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787378322.015755:0:14885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787378322.015815:0:14862:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787378322.015841:0:14862:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787378322.015858:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf641c00/0xdd3c5462d7853db4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853dbb expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.015870:0:14862:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebbf641c00/0xdd3c5462d7853db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853dbb expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378322.016041:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626638080 00000100:00100000:2.0:1787378322.016060:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626638080 00000100:00100000:2.0:1787378322.016108:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787378322.016115:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874201626638080:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787378322.016141:0:14228:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:2.0:1787378322.016286:0:14228:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdd3c5462d7853dd0 00000004:00100000:2.0:1787378322.016303:0:14228:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787378322.016339:0:14228:0:(import.c:65:import_set_state_nolock()) ffff9eea82543800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378322.016436:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874201626638080:12345-0@lo:38:llog_process_th.0 Request processed in 320us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378322.016444:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787378322.016471:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787378322.016475:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787378322.016478:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787378322.016481:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1787378322.016556:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eebae6f8700 x1874201626638080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787378332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378322.016568:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787378322.016575:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787378322.016582:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787378322.016587:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787378322.016589:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eeb9a1e0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787378322.016595:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874201626638080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787378322.016627:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626638208:0@lo:400:kworker.0 00000100:00100000:2.0:1787378322.016663:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378322.016712:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626638208 00000100:00100000:2.0:1787378322.016717:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626638208 00000100:00100000:2.0:1787378322.016765:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378322.016771:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626638208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378322.016806:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626638208:12345-0@lo:400:kworker.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378322.016812:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787378322.016839:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eebae275500 x1874201626638208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378322.016848:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626638208:0@lo:400:kworker.0 00000020:01000004:1.0:1787378322.017267:0:14862:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787378322.017270:0:14862:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787378322.017271:0:14862:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378322.017272:0:14862:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378322.017273:0:14862:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378322.017275:0:14862:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378322.017276:0:14862:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378322.017278:0:14862:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378322.017279:0:14862:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787378322.017284:0:14862:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787378322.017286:0:14862:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787378322.017287:0:14862:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787378322.017289:0:14862:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378322.017290:0:14862:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378322.017291:0:14862:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378322.017292:0:14862:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378322.017297:0:14862:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378322.017298:0:14862:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378322.017298:0:14862:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787378322.017313:0:14862:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787378322.017325:0:14862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626638336:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787378322.017360:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378322.017685:0:14862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378322.017807:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626638336 00000100:00100000:2.0:1787378322.017813:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626638336 00000100:00100000:2.0:1787378322.017849:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787378322.017857:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14862:x1874201626638336:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787378322.017876:0:14222:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787378322.017948:0:14222:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787378322.067524:0:14222:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787378322.067544:0:14222:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787378322.067998:0:14244:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787378322.068003:0:14244:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787378322.068025:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378322.068042:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 16 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378322.068050:0:14244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378322.068086:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 16 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378322.068099:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 16 pid: 14222 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378322.068113:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1874201626638464:0@lo:104: 00000100:00100000:0.0:1787378322.068176:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378322.068211:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8672cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378322.068301:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626638464 00000100:00100000:1.0:1787378322.068309:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626638464 00000100:00100000:1.0:1787378322.068350:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787378322.068358:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:14244:x1874201626638464:12345-0@lo:104: 00010000:00010000:1.0:1787378322.068372:0:14212:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068436:0:14212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787378322.068442:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:14244:x1874201626638464:12345-0@lo:104: Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378322.068449:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787378322.068478:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378322.068483:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068491:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05600 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:1.0:1787378322.068495:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068504:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787378322.068528:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378322.068534:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787378322.068560:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068567:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378322.068585:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068592:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9dd05600/0xdd3c5462d7853d3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d44 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068606:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378322.068608:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378322.068610:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378322.068631:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626638592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787378322.068658:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378322.068859:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626638592 00000100:00100000:1.0:1787378322.068864:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626638592 00010000:00010000:1.0:1787378322.068881:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 17 pid: 14222 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378322.068903:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787378322.068909:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:3313:x1874201626638592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378322.068919:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378322.068925:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 17 pid: 14222 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068942:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 17 pid: 14222 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068959:0:14215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068966:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787378322.068979:0:14215:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001526799s 00010000:00010000:1.0:1787378322.068983:0:14215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068990:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.068997:0:14215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.069003:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.069008:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378322.069012:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.069018:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.069026:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.069043:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378322.069072:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:3313:x1874201626638592:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378322.069079:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787378322.069118:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626638592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378322.069145:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7853d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7853d3d expref: 16 pid: 14222 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378322.069155:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1874201626638464:0@lo:104: 00010000:00010000:1.0:1787378322.069166:0:14244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.069175:0:14244:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.069181:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378322.069188:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853dd7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378322.078005:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14862:x1874201626638336:12345-0@lo:253:mount.lustre.0 Request processed in 60139us (60633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378322.078020:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787378322.078104:0:14862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14862:1874201626638336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787378322.078119:0:14862:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787378322.078122:0:14862:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787378322.078124:0:14862:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787378322.078125:0:14862:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378322.078126:0:14862:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378322.078127:0:14862:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378322.078140:0:14862:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378322.078142:0:14862:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378322.078144:0:14862:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378322.078145:0:14862:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787378322.078161:0:14862:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787378322.082396:0:14862:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378322.082589:0:14862:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378322.083137:0:14862:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378322.083295:0:14862:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378322.083451:0:14862:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378322.083645:0:14862:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787378322.084547:0:14862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787378322.166461:0:14862:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787378322.166471:0:14862:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787378322.166502:0:14862:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787378322.166551:0:14862:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787378322.166565:0:14862:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787378322.166591:0:14862:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787378322.458059:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378323.484439:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787378323.745353:0:14225:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787378323.745361:0:14225:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9eebbc37f000 from 7 10000000:01000000:1.0:1787378323.745366:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787378323.745423:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378323.745436:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378323.745448:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378323.745544:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626638720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378323.745608:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378323.745788:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb894b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787378323.748983:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626638720 00000100:00100000:1.0:1787378323.748997:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626638720 00000100:00100000:1.0:1787378323.749050:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787378323.749059:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+15:14225:x1874201626638720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378323.749075:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378323.749092:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853dde expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378323.749118:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 16 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378323.749136:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 16 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378323.749145:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641200, rc 0) 00000100:00100000:1.0:1787378323.749229:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14225:x1874201626638720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378323.749237:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787378323.749297:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626638720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378323.749312:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378323.749322:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378323.749382:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626638848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787378323.749428:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378323.749456:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb894b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787378323.749469:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626638848 00000100:00100000:1.0:1787378323.749472:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626638848 00000100:00100000:1.0:1787378323.749491:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787378323.749497:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14225:x1874201626638848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787378323.749510:0:14222:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787378323.749524:0:14222:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787378323.749527:0:14222:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787378323.749593:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14225:x1874201626638848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378323.749607:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787378323.749636:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626638848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787378323.749699:0:14225:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787378323.749706:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378323.749714:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378324.505851:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378325.530838:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378326.559018:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787378327.066035:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787378327.066042:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787378327.066045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787378327.066047:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787378327.066084:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378327.066112:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626638976:0@lo:400:kworker.0 00000100:00100000:2.0:1787378327.066185:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378327.066245:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626639104:0@lo:400:kworker.0 00000100:00100000:2.0:1787378327.066272:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378327.066291:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378327.066297:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626639232:0@lo:400:kworker.0 00000100:00100000:2.0:1787378327.066316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378327.066346:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626638976 00000100:00100000:2.0:1787378327.066353:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626638976 00000100:00100000:2.0:1787378327.066406:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787378327.066415:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:3313:x1874201626638976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378327.066468:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:3313:x1874201626638976:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378327.066476:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787378327.066511:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626639104 00000100:00100000:2.0:1787378327.066514:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626639104 00000100:00100000:2.0:1787378327.066535:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626639232 00000100:00100000:2.0:1787378327.066538:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626639232 00000100:00100000:2.0:1787378327.066560:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787378327.066565:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626639104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378327.066597:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626639104:12345-0@lo:400:kworker.0 Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378327.066603:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787378327.066614:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378327.066619:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626639232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378327.066645:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626639232:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378327.066662:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787378327.066704:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae274000 x1874201626639232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378327.066737:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626639232:0@lo:400:kworker.0 00010000:00080000:2.0:1787378327.066750:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae274a80 x1874201626639104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378327.066758:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626639104:0@lo:400:kworker.0 00000100:00100000:2.0:1787378327.066789:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626638976:0@lo:400:kworker.0 00000100:00080000:1.0:1787378327.067840:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787378327.584140:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378328.602046:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787378329.042093:0:15231:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1787378329.309266:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787378329.632150:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378330.651926:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378331.681793:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787378332.185835:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787378332.185842:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787378332.185845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787378332.185849:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787378332.185899:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626639488:0@lo:400:kworker.0 00000100:00100000:2.0:1787378332.185979:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378332.186037:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787378332.186044:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3314:1874201626639360:0@lo:400:kworker.0 00000100:00100000:2.0:1787378332.186073:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378332.186119:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626639616:0@lo:400:kworker.0 00000100:00100000:2.0:1787378332.186443:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378332.192398:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626639360 00000100:00100000:3.0:1787378332.192414:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626639360 00000100:00100000:3.0:1787378332.192480:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787378332.192490:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:3314:x1874201626639360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378332.192582:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:3314:x1874201626639360:12345-0@lo:400:kworker.0 Request processed in 93us (6506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378332.192589:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787378332.193310:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3314:1874201626639360:0@lo:400:kworker.0 00000100:00100000:0.0:1787378332.194704:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626639488 00000100:00100000:0.0:1787378332.194713:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626639488 00000100:00100000:0.0:1787378332.194776:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626639616 00000100:00100000:0.0:1787378332.194780:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626639616 00000100:00080000:0.0:1787378332.194804:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378332.194838:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787378332.194846:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626639488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378332.194935:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626639488:12345-0@lo:400:kworker.0 Request processed in 89us (8955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378332.194943:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787378332.194983:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae274a80 x1874201626639488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787378332.194997:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626639488:0@lo:400:kworker.0 00000100:00100000:0.0:1787378332.195022:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378332.195029:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626639616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378332.195063:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626639616:12345-0@lo:400:kworker.0 Request processed in 35us (8620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378332.195070:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787378332.197468:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae274000 x1874201626639616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378332.197488:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626639616:0@lo:400:kworker.0 00000100:00100000:3.0:1787378332.257347:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787378317/real 1787378317] req@ffff9eebad2e1880 x1874201626635008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787378332 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378332.257382:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eebad2e1880 x1874201626635008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787378332 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378332.257392:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787378317/real 1787378317] req@ffff9eebad2e2d80 x1874201626635136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787378332 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378332.257403:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eebad2e2d80 x1874201626635136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787378332 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787378332.257421:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebad27c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787378332.257445:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787378332.257449:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626635008:0@lo:8:kworker.0 00000100:00080000:3.0:1787378332.257455:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787378332.257460:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787378332.257463:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626635136:0@lo:8:kworker.0 00000100:00080000:2.0:1787378332.257801:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787378332.257807:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787378332.257810:0:478:0:(import.c:65:import_set_state_nolock()) ffff9eebad27c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787378332.257815:0:478:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1787378332.257819:0:478:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787378332.257826:0:478:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eebad27c000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787378332.257859:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae274000 x1874201626639744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787378332.257881:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787378332.257885:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787378332.257887:0:478:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787378332.257889:0:478:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1787378332.257892:0:478:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787378332.257896:0:478:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eebbc248800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787378332.257908:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae274e00 x1874201626639872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787378332.258027:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626639744:0@lo:8:kworker.0 00000100:00100000:3.0:1787378332.258090:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378332.258151:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626639872:0@lo:8:kworker.0 00000100:00100000:3.0:1787378332.258174:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378332.258290:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626639744 00000100:00100000:2.0:1787378332.258298:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626639744 00000100:00100000:2.0:1787378332.258343:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626639872 00000100:00100000:2.0:1787378332.258347:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626639872 00000100:00100000:2.0:1787378332.258361:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378332.258368:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874201626639744:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787378332.258395:0:14864:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1787378332.258425:0:14864:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7853dec 00002000:00100000:2.0:1787378332.258438:0:14864:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9eea82545000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113675 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787378332.258454:0:14864:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787378332.258457:0:14864:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787378332.258828:0:14864:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787378332.258854:0:14864:0:(import.c:65:import_set_state_nolock()) ffff9eea82545800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378332.258912:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874201626639744:12345-0@lo:8:kworker.0 Request processed in 542us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378332.259371:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378332.259394:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378332.259400:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874201626639872:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787378332.259414:0:14864:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787378332.259450:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874201626639872:12345-0@lo:8:kworker.0 Request processed in 48us (1274us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787378332.259456:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787378332.259503:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae274000 x1874201626639744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787378352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378332.259514:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787378332.259521:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787378332.259530:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787378332.259535:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787378332.259537:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebad27c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787378332.259558:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787378332.259564:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626639744:0@lo:8:kworker.0 00000100:00080000:2.0:1787378332.259581:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787378332.259585:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787378332.259588:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626639872:0@lo:8:kworker.0 00000004:00080000:3.0:1787378332.259699:0:14251:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787378332.259739:0:14251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14251:1874201626640128:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787378332.259772:0:14251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378332.259790:0:14251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787378332.259815:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626640128 00000100:00100000:3.0:1787378332.259819:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626640128 00000100:00100000:3.0:1787378332.259856:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787378332.259863:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14251:x1874201626640128:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787378332.262446:0:14866:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787378332.262456:0:14866:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787378332.262461:0:14866:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:2.0:1787378332.262969:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626640000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787378332.263033:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787378332.270763:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787378332.270860:0:14250:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787378332.271366:0:14250:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 468533645733ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787378332.277844:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626640000 00000100:00100000:2.0:1787378332.277859:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626640000 00000100:00100000:2.0:1787378332.277914:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378332.277936:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874201626640000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787378332.277975:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378332.278065:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874201626640000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (15030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378332.278074:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787378332.278124:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebbb721180 x1874201626640000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378332.278146:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626640000:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1787378332.309394:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.309411:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.309433:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.309440:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.309447:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.309468:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.309480:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.309488:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.309520:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787378332.309553:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378332.309567:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.309583:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05400 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378332.309588:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.309612:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.309638:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.309660:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d7853df3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.309695:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378332.309701:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378332.309703:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.310102:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.310118:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310128:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.310132:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.310136:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310146:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310156:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310163:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310181:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787378332.310383:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378332.310392:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.310403:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378332.310411:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.310421:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.310438:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.310446:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045524789/0xdd3c5462d7853dfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.310463:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378332.310465:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378332.310467:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.310644:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.310652:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310662:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.310666:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.310670:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310681:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310697:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310705:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.310747:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787378332.311155:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.311162:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311171:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.311175:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.311179:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311189:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311198:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311206:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311242:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787378332.311258:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787378332.311264:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311272:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.311276:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311286:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311304:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311312:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfb0cd04/0xdd3c5462d7853e01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.311333:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.315174:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.315192:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.315198:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.315241:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.315269:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.315276:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002115867e/0xdd3c5462d7853e08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.315310:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.315312:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.315316:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378332.317449:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.321485:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.321506:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321530:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.321536:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.321543:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321562:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321573:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321593:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321624:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.321649:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.321657:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321666:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.321672:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321683:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321707:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321716:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d7853e0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.321776:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.321780:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.321785:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.325710:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.325757:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.325790:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.325797:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.325805:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.325822:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.325833:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.325840:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.325870:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378332.326148:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.326161:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.326190:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.326196:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.326208:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.326238:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.326247:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5aaca60/0xdd3c5462d7853e16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.326279:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.326281:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.326283:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.327479:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.327493:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.327511:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.327516:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.327523:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.327538:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.327559:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.327567:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.327593:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787378332.329077:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787378332.329090:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.329104:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05a00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378332.329226:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.329238:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.329265:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.329285:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce653d5e/0xdd3c5462d7853e1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.329311:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378332.329313:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378332.329315:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.331013:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.331032:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.331052:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.331057:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.331064:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.331080:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.331090:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.331098:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.331140:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378332.331478:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.331490:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.331503:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04a00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.331508:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.331518:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.331548:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.331556:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b9aca7/0xdd3c5462d7853e24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.331579:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.331581:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.331583:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.335164:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.335179:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.335201:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.335208:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.335216:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.335233:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.335243:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.335251:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.335290:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378332.335541:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.335553:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.335566:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.335571:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.335582:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.335604:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.335611:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010b2bcb2/0xdd3c5462d7853e2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.335651:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.335653:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.335655:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.339552:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.339569:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.339592:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.339605:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.339614:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.339634:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.339647:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.339656:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.339695:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787378332.340209:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.340216:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340227:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.340231:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.340235:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340246:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340255:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340270:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340293:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787378332.340313:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787378332.340320:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340329:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.340369:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340381:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340402:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340410:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcc7c15/0xdd3c5462d7853e32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340433:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.340436:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340456:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.340459:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340468:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340480:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340487:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7853e39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.340501:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.340503:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.340505:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.341013:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.341022:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341033:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.341037:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.341042:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341052:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341068:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341075:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341091:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.341100:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.341103:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341110:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.341114:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341122:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341134:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341142:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341156:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.341163:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.341165:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.341592:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.341598:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341606:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.341609:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.341614:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341623:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341630:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341637:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341651:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.341660:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.341663:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341669:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.341673:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341692:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341704:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.341711:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378332.344674:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.349426:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.349436:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.349439:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.350292:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.350304:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350324:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.350330:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.350349:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350364:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350376:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350391:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350415:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.350430:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.350437:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350445:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.350451:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350461:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350480:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350488:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cce2c84/0xdd3c5462d7853e4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350503:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.350505:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.350506:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.350923:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.350936:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350944:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.350947:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.350952:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350960:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350968:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350976:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.350990:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.350998:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.351002:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351008:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.351012:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351020:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351039:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351046:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853e55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351062:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.351064:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.351067:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.351597:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.351605:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351615:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.351618:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.351623:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351632:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351639:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351647:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.351686:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378332.351741:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.351756:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.351770:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.351775:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.351787:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.351812:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.351820:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b84bc835/0xdd3c5462d7853e5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.351852:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.351855:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.351860:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.352197:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.352205:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.352214:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.352217:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.352221:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.352230:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.352239:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.352247:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.352274:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378332.354430:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.354443:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.354470:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.354475:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.354487:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.354508:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.354517:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853e63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.354540:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.354542:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.354544:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.360155:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.362304:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.362345:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.362383:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.362390:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.362408:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.362420:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.362428:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.362461:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378332.362509:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.362524:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.362540:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.362547:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.362558:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.362606:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.362615:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f43fc7c/0xdd3c5462d7853e6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.362663:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.362666:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.362669:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.363321:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.363332:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363356:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.363359:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.363365:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363376:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363385:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363400:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363426:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.363443:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.363448:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363457:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.363461:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363470:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363487:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363494:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853e71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.363513:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.363515:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.363516:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.364033:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.364047:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364057:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.364061:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.364065:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364074:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364082:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364088:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364105:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.364114:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.364119:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364125:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484a00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.364128:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364136:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364153:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364161:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc01531e/0xdd3c5462d7853e78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.364177:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.364179:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.364181:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.369981:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.369997:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370018:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.370023:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.370031:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370047:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370060:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370069:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370115:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.370134:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.370141:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370150:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.370156:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370305:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370330:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370347:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c906bdae/0xdd3c5462d7853e7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.370423:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.370426:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.370428:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.371009:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.371018:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371031:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.371042:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.371047:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371059:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371069:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371077:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371096:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.371110:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.371115:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371123:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.371127:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371136:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371149:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371494:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008416e6c0/0xdd3c5462d7853e86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.371517:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.371519:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.371521:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.372067:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.372074:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.372085:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.372089:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.372095:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.372105:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.372115:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.372122:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.372141:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.372152:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.372164:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.373745:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485400 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.373754:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.373767:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.373794:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.373802:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912bd19e/0xdd3c5462d7853e8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.373843:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.373846:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.373851:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.377202:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.377219:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.377241:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.377247:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.377255:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.377286:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.377297:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.377305:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.377347:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378332.377604:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.377619:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.377635:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.377640:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.377653:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.377681:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.377689:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b21bca5/0xdd3c5462d7853e94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.377765:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.377768:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.377774:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.378076:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.378085:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378097:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.378101:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.378106:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378116:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378126:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378147:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378448:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378332.378468:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378332.378474:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378484:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb80031000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378332.378489:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378499:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378516:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378524:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001640991c/0xdd3c5462d7853e9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.378546:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.378548:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378332.378550:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.379098:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.379113:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.379124:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.379129:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.379134:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.379145:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.379154:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.379162:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.382316:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378332.384313:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.384332:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.384360:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb80031800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.384373:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.384387:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.384414:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.384422:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853ea2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.384458:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.384460:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.384462:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.387553:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.387575:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.387599:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.387605:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.387612:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.387630:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.387664:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.387673:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.387701:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787378332.388784:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787378332.388798:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.388813:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb80030600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378332.388819:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.388830:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.388851:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.388859:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b534351/0xdd3c5462d7853ea9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378332.388884:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378332.388886:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378332.388888:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378332.391321:0:14866:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378332.391345:0:14866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.391496:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1787378332.391503:0:14866:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378332.391512:0:14866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.391530:0:14866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.391541:0:14866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.391548:0:14866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378332.391586:0:14866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787378332.391882:0:14866:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1787378332.394277:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14251:x1874201626640128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 134400us (134490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378332.394297:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787378332.394473:0:14251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14251:1874201626640128:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787378332.394492:0:14251:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787378332.394560:0:14251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14251:1874201626640256:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787378332.394622:0:14251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378332.394693:0:14251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787378332.394745:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626640256 00000100:00100000:3.0:1787378332.394752:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626640256 00000100:00100000:3.0:1787378332.394803:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787378332.394814:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14251:x1874201626640256:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787378332.394876:0:14865:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1787378332.396438:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378332.396453:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.396489:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378332.396495:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.396507:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.396535:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.396543:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a2bffad/0xdd3c5462d7853eb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378332.396569:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.396572:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378332.396573:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378332.423075:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14251:x1874201626640256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 28249us (28439us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787378332.423092:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378332.423519:0:14251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14251:1874201626640256:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787378332.423541:0:14251:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:3.0:1787378332.426522:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787378332.712460:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787378332.809121:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787378332.809142:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1787378333.724065:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378334.748368:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378335.773652:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787378336.280397:0:15535:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787378336.280401:0:15535:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787378336.283213:0:15535:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9eebb8d39000 00000020:01000004:2.0:1787378336.283235:0:15535:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787378336.283249:0:15535:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787378336.283264:0:15535:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9eeb883b0000) 00000020:00000080:2.0:1787378336.283283:0:15535:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787378336.324209:0:15535:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787378336.324973:0:15535:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787378336.325670:0:15535:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787378336.326204:0:15535:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787378336.327669:0:15535:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787378336.328047:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:3.0:1787378336.328128:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 517: rc = 0 00100000:10000000:3.0:1787378336.328247:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 517: rc = 0 00100000:10000000:3.0:1787378336.329035:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 529: rc = 0 00100000:10000000:3.0:1787378336.329269:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 529: rc = 0 00100000:10000000:3.0:1787378336.329923:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 529: rc = 0 00100000:10000000:3.0:1787378336.330149:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 529: rc = 0 00100000:10000000:3.0:1787378336.330385:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 529: rc = 0 00100000:10000000:3.0:1787378336.331003:0:15535:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 529: rc = 0 00000020:00000080:3.0:1787378336.331653:0:15535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787378336.331665:0:15535:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787378336.331675:0:15535:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdd3c5462d7853ebe 00000020:01000004:3.0:1787378336.331682:0:15535:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787378336.331703:0:15535:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787378336.331706:0:15535:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787378336.331712:0:15535:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787378336.331812:0:15535:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787378336.331817:0:15535:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787378336.341973:0:15535:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787378336.342011:0:15535:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787378336.342015:0:15535:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787378336.342017:0:15535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787378336.342018:0:15535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787378336.342020:0:15535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787378336.342021:0:15535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787378336.342022:0:15535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787378336.342023:0:15535:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787378336.342024:0:15535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787378336.342030:0:15535:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787378336.342033:0:15535:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787378336.342035:0:15535:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787378336.342036:0:15535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787378336.342037:0:15535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787378336.342038:0:15535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787378336.342039:0:15535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787378336.342040:0:15535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787378336.342041:0:15535:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787378336.342042:0:15535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787378336.342042:0:15535:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787378336.342070:0:15535:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787378336.342090:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787378336.342154:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378336.342400:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378336.344683:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626640384 00000100:00100000:2.0:1787378336.344696:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626640384 00000100:00100000:2.0:1787378336.344764:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787378336.344773:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:15535:x1874201626640384:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787378336.344819:0:14222:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787378336.344823:0:14222:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787378336.344827:0:14222:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787378336.367999:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:15535:x1874201626640384:12345-0@lo:253:mount.lustre.0 Request processed in 23218us (25836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378336.368014:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787378336.368120:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787378336.368221:0:15535:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787378336.368224:0:15535:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787378336.368226:0:15535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787378336.368227:0:15535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787378336.368228:0:15535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787378336.368230:0:15535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787378336.368231:0:15535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787378336.368233:0:15535:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787378336.368235:0:15535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787378336.368236:0:15535:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787378336.368255:0:15535:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eebb8d39000 from lustre-OST0001 10000000:01000000:0.0:1787378336.368278:0:15535:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787378336.368281:0:15535:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787378336.368289:0:15535:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eeb883b3380 local copy 00010000:00010000:0.0:1787378336.368299:0:15535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378336.372049:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787378336.372112:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378336.372272:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb87f4a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787378336.372938:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626640512 00000100:00100000:3.0:1787378336.372947:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626640512 00000100:00100000:3.0:1787378336.373002:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787378336.373011:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:15535:x1874201626640512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378336.373844:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:15535:x1874201626640512:12345-0@lo:501:mount.lustre.0 Request processed in 831us (1727us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787378336.373853:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787378336.373951:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640512:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787378336.373970:0:15535:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787378336.374153:0:15535:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787378336.374162:0:15535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.374173:0:15535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebbf640400/0xdd3c5462d7853c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853c6b expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787378336.374198:0:15535:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eebb8d39000 10000000:01000000:1.0:1787378336.374202:0:15535:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787378336.374207:0:15535:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787378336.374209:0:15535:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787378336.374213:0:15535:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787378336.374216:0:15535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787378336.374242:0:15535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640200/0xdd3c5462d7853ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.374249:0:15535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebbf640200/0xdd3c5462d7853ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.374258:0:15535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebbf640200/0xdd3c5462d7853ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378336.374284:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787378336.374333:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378336.374369:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb87f4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787378336.375046:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626640640 00000100:00100000:2.0:1787378336.375054:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626640640 00000100:00100000:2.0:1787378336.375097:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787378336.375104:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:15535:x1874201626640640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787378336.375115:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378336.375195:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc0800/0xdd3c5462d7853ecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853ec5 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.375225:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc0800/0xdd3c5462d7853ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853ec5 expref: 17 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.375236:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc0800/0xdd3c5462d7853ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853ec5 expref: 17 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.375246:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0800, rc 0) 00000100:00100000:2.0:1787378336.375296:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626640640:12345-0@lo:101:mount.lustre.0 Request processed in 192us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378336.375588:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787378336.375615:0:15535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebbf640200/0xdd3c5462d7853ec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ecc expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378336.375624:0:15535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebbf640200/0xdd3c5462d7853ec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853ecc expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378336.375686:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000040:00080000:1.0:1787378336.379990:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787378336.383515:0:15535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787378336.385172:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787378336.385226:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787378336.385260:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787378336.385318:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787378336.385357:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787378336.385391:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787378336.385459:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787378336.385468:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787378336.387916:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787378336.387989:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378336.388094:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb87f4a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787378336.390552:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626640768 00000100:00100000:3.0:1787378336.390612:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626640768 00000100:00100000:3.0:1787378336.390732:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787378336.390743:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626640768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378336.391321:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626640768:12345-0@lo:501:mount.lustre.0 Request processed in 578us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378336.391329:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787378336.391427:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787378336.391475:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787378336.391518:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378336.395319:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8ce4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378336.399417:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626640896 00000100:00100000:1.0:1787378336.399432:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626640896 00000100:00100000:1.0:1787378336.399496:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787378336.399507:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626640896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787378336.404132:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626640896:12345-0@lo:503:mount.lustre.0 Request processed in 4619us (12605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378336.404147:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787378336.404297:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626640896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787378336.405028:0:15535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787378336.405111:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787378336.405162:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378336.405199:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8ce4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378336.405577:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626641024 00000100:00100000:1.0:1787378336.405584:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626641024 00000100:00100000:1.0:1787378336.405618:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787378336.405626:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626641024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787378336.405836:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626641024:12345-0@lo:502:mount.lustre.0 Request processed in 209us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378336.405844:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787378336.406022:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787378336.406245:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787378336.406293:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787378336.406338:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787378336.406381:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787378336.406417:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787378336.406462:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787378336.406508:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787378336.406543:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787378336.406657:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787378336.406686:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787378336.406763:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378336.406793:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8ce4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378336.406873:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626641152 00000100:00100000:1.0:1787378336.406879:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626641152 00000100:00100000:1.0:1787378336.406913:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787378336.406921:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626641152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787378336.407060:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626641152:12345-0@lo:502:mount.lustre.0 Request processed in 139us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378336.407067:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787378336.407188:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787378336.407247:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787378336.407257:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787378336.417362:0:15536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787378336.417375:0:15536:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787378336.417383:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.417385:0:15536:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787378336.417392:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787378336.417409:0:15536:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9eebb5380000) 00000020:00000080:0.0:1787378336.417432:0:15536:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787378336.417438:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787378336.417500:0:15536:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eebb8d39000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787378336.417509:0:15536:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787378336.417516:0:15536:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdd3c5462d7853eda 00010000:00010000:0.0:1787378336.424499:0:15536:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787378336.425240:0:15536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787378336.433406:0:15536:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787378336.435689:0:15536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787378336.435704:0:15536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378336.435711:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.435713:0:15536:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787378336.435716:0:15536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378336.435761:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.435762:0:15536:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787378336.435767:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787378336.435769:0:15536:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787378336.435772:0:15536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378336.435774:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.435782:0:15536:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787378336.435785:0:15536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378336.435787:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.435789:0:15536:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787378336.435792:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787378336.435855:0:15536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378336.435859:0:15536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.435860:0:15536:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787378336.435863:0:15536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787378336.437077:0:15535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787378336.437110:0:15535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787378336.437133:0:15535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640200/0xdd3c5462d7853ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ecc expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.437146:0:15535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebbf640200/0xdd3c5462d7853ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ecc expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378336.437154:0:15535:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebb8d39000 from 1 10000000:01000000:3.0:1787378336.437156:0:15535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787378336.437188:0:15535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.437195:0:15535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.437205:0:15535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378336.437227:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787378336.437298:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.437345:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd900 going to sleep for 11 seconds 00000100:00100000:0.0:1787378336.440781:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626641280 00000100:00100000:0.0:1787378336.440794:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626641280 00000100:00100000:0.0:1787378336.440850:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787378336.440860:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:15535:x1874201626641280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787378336.440876:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378336.440893:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853ee1 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378336.440919:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 18 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378336.440930:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 18 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378336.440938:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a800, rc 0) 00000100:00100000:0.0:1787378336.441009:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641280:12345-0@lo:101:mount.lustre.0 Request processed in 151us (3711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378336.441016:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787378336.441318:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378336.441336:0:15535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.441358:0:15535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787378336.444019:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787378336.444545:0:15535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787378336.450354:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787378336.450468:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787378336.450593:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787378336.450602:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787378336.450701:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378336.450800:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.450839:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd900 going to sleep for 11 seconds 00000100:00100000:0.0:1787378336.451014:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626641408 00000100:00100000:0.0:1787378336.451021:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626641408 00000100:00100000:0.0:1787378336.451061:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787378336.451070:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787378336.451335:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641408:12345-0@lo:501:mount.lustre.0 Request processed in 264us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378336.451343:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787378336.451470:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378336.451505:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787378336.451545:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.451582:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd900 going to sleep for 11 seconds 00000100:00100000:0.0:1787378336.451949:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626641536 00000100:00100000:0.0:1787378336.451954:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626641536 00000100:00100000:0.0:1787378336.452020:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787378336.452029:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787378336.452334:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641536:12345-0@lo:503:mount.lustre.0 Request processed in 306us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378336.452342:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787378336.452414:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787378336.453325:0:15535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787378336.453408:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787378336.453463:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.453813:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378336.453982:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626641664 00000100:00100000:2.0:1787378336.453989:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626641664 00000100:00100000:2.0:1787378336.454025:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787378336.454033:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787378336.454245:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641664:12345-0@lo:502:mount.lustre.0 Request processed in 212us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378336.454253:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787378336.454360:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787378336.454671:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787378336.454759:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787378336.454815:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787378336.454873:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787378336.454969:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787378336.455020:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787378336.455052:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787378336.455078:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787378336.455110:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787378336.455159:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.455190:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787378336.455269:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626641792 00000100:00100000:2.0:1787378336.455274:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626641792 00000100:00100000:2.0:1787378336.455303:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787378336.455321:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787378336.455478:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641792:12345-0@lo:502:mount.lustre.0 Request processed in 158us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378336.455486:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787378336.455708:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787378336.456684:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787378336.456704:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787378336.458050:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378336.458060:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.458062:0:15540:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787378336.458069:0:15540:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eebb8d39000 00000020:00000080:0.0:1787378336.458071:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787378336.458078:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378336.458080:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.458081:0:15540:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787378336.458083:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378336.458086:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.458087:0:15540:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787378336.458090:0:15540:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eebb8d39000 00000020:00000080:0.0:1787378336.458092:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787378336.458291:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378336.458296:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.458298:0:15540:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787378336.458300:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787378336.458303:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.458305:0:15540:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787378336.458320:0:15540:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eebb8d39000 00000020:00000080:0.0:1787378336.458336:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787378336.458668:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787378336.458672:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787378336.458674:0:15540:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787378336.458678:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787378336.463145:0:15535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787378336.463195:0:15535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787378336.463215:0:15535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.463228:0:15535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378336.463279:0:15535:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787378336.463282:0:15535:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eebb8d39000 10000000:01000000:3.0:1787378336.463285:0:15535:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eebb8d39000 10000000:01000000:3.0:1787378336.463289:0:15535:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787378336.463295:0:15535:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9eebb8d39000 from 1 10000000:01000000:3.0:1787378336.463298:0:15535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787378336.463344:0:15535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7853eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.463353:0:15535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7853eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.463377:0:15535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7853eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378336.463400:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787378336.463466:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.463508:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787378336.463537:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626641920 00000100:00100000:3.0:1787378336.463543:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626641920 00000100:00100000:3.0:1787378336.463597:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787378336.463606:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626641920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378336.463619:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378336.463635:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb81484800/0xdd3c5462d7853ef6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853eef expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.463658:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb81484800/0xdd3c5462d7853ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853eef expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.463667:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb81484800/0xdd3c5462d7853ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853eef expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.463676:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb81484800, rc 0) 00000100:00100000:3.0:1787378336.463714:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626641920:12345-0@lo:101:mount.lustre.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378336.463739:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787378336.463790:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626641920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787378336.463804:0:15535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7853eef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ef6 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378336.463820:0:15535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7853eef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853ef6 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787378336.464466:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787378336.464783:0:15535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787378336.465031:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787378336.465075:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787378336.465107:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787378336.465154:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787378336.465190:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787378336.465237:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787378336.465270:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787378336.465335:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787378336.465386:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787378336.465422:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787378336.465454:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787378336.465498:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787378336.465533:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787378336.465566:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787378336.465612:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787378336.465648:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787378336.465682:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787378336.465755:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787378336.465795:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787378336.465835:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787378336.465901:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787378336.465942:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787378336.465977:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787378336.466042:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787378336.466077:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787378336.466106:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787378336.466167:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787378336.466206:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787378336.466244:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787378336.466296:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787378336.478821:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787378336.478877:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787378336.478913:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787378336.478992:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787378336.479029:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787378336.479073:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787378336.479107:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787378336.479197:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787378336.479205:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787378336.479320:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626642048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378336.479386:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.479425:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787378336.479594:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626642048 00000100:00100000:1.0:1787378336.479601:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626642048 00000100:00100000:1.0:1787378336.479650:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787378336.479659:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626642048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787378336.479920:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626642048:12345-0@lo:501:mount.lustre.0 Request processed in 261us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378336.479929:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787378336.480693:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626642048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787378336.480757:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626642176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787378336.480809:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.480841:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787378336.480912:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626642176 00000100:00100000:0.0:1787378336.480918:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626642176 00000100:00100000:0.0:1787378336.480956:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787378336.480964:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626642176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787378336.481253:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626642176:12345-0@lo:503:mount.lustre.0 Request processed in 290us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378336.481260:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787378336.482456:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626642176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787378336.483030:0:15535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787378336.483111:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626642304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787378336.483171:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.483213:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787378336.483386:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626642304 00000100:00100000:2.0:1787378336.483392:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626642304 00000100:00100000:2.0:1787378336.483436:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787378336.483444:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626642304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787378336.486125:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626642304:12345-0@lo:502:mount.lustre.0 Request processed in 2671us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378336.486139:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787378336.486710:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626642304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787378336.487021:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787378336.487089:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787378336.487125:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787378336.487172:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787378336.487209:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787378336.487258:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787378336.487293:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787378336.487340:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787378336.487385:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787378336.487424:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787378336.487460:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787378336.487507:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787378336.487543:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787378336.490337:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787378336.490482:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787378336.490521:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787378336.490555:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787378336.492837:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787378336.492890:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787378336.492926:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787378336.492976:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787378336.493013:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787378336.493049:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787378336.493099:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787378336.493134:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787378336.493165:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787378336.493216:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787378336.493253:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787378336.493285:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787378336.493344:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787378336.493397:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787378336.493446:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787378336.493481:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787378336.493541:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787378336.496368:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787378336.496468:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787378336.496502:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787378336.496534:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787378336.496653:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787378336.496692:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787378336.496758:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626642432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787378336.505242:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.505334:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787378336.507766:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626642432 00000100:00100000:0.0:1787378336.507780:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626642432 00000100:00100000:0.0:1787378336.507883:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787378336.507894:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626642432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787378336.508186:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626642432:12345-0@lo:502:mount.lustre.0 Request processed in 294us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378336.508194:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787378336.508321:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626642432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787378336.508437:0:15535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787378336.508453:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787378336.518557:0:15545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787378336.519679:0:15545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9eeb87654d40) 00000020:00000080:3.0:1787378336.519709:0:15545:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787378336.520041:0:15545:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eebb8d39000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787378336.520046:0:15545:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eebb8d39000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787378336.520048:0:15545:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eebb8d39000 3 00010000:00080000:3.0:1787378336.520075:0:15545:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eea82843800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1787378336.528117:0:15545:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787378336.528216:0:15545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787378336.528255:0:15545:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787378336.528267:0:15545:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdd3c5462d7853f04 00000100:00080000:2.0:1787378336.528277:0:15545:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787378336.528282:0:15545:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eea82843800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787378336.528341:0:15545:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae274000 x1874201626642560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787378336.528370:0:15545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787378336.528526:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874201626642560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787378336.528604:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787378336.528783:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787378336.528788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787378336.528791:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787378336.528795:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1787378336.528799:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787378336.528810:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eebbc248800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787378336.528826:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebae6fb800 x1874201626642816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787378336.528971:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626643072:0@lo:400:kworker.0 00000100:00100000:1.0:1787378336.529005:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378336.529040:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626642560 00000100:00100000:1.0:1787378336.529046:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626642560 00000100:00100000:1.0:1787378336.529069:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626643072 00000100:00100000:1.0:1787378336.529071:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626643072 00000100:00100000:1.0:1787378336.529101:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378336.529109:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626643072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378336.529153:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626643072:12345-0@lo:400:kworker.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378336.529161:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378336.529179:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787378336.529183:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874201626642560:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787378336.529207:0:14228:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1787378336.529234:0:14228:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdd3c5462d7853f0b 00000004:00100000:1.0:1787378336.529249:0:14228:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787378336.529277:0:14228:0:(import.c:65:import_set_state_nolock()) ffff9eeb86302800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787378336.529319:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874201626642560:12345-0@lo:38:llog_process_th.0 Request processed in 123us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378336.529325:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787378336.529347:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787378336.529371:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae6f9880 x1874201626643072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378336.529396:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626643072:0@lo:400:kworker.0 00000100:00100000:3.0:1787378336.529466:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626642688:0@lo:400:kworker.0 00000100:00100000:3.0:1787378336.529507:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.529536:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787378336.529543:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626642944:0@lo:400:kworker.0 00000100:00100000:3.0:1787378336.529573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378336.529595:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626642816:0@lo:8:kworker.0 00000100:00100000:3.0:1787378336.529616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787378336.529644:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae274000 x1874201626642560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787378346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378336.529651:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787378336.529664:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787378336.529672:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787378336.529676:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787378336.529679:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eea82843800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787378336.529686:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874201626642560:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787378336.530692:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626642944 00000100:00100000:2.0:1787378336.530702:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626642944 00000100:00100000:2.0:1787378336.530772:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787378336.530780:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626642944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378336.530844:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626642944:12345-0@lo:400:kworker.0 Request processed in 64us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378336.530852:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787378336.530874:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626642688 00000100:00100000:2.0:1787378336.530878:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626642688 00000100:00100000:2.0:1787378336.530905:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626642816 00000100:00100000:2.0:1787378336.530908:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626642816 00000100:00100000:2.0:1787378336.530920:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378336.530927:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626642688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378336.530958:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626642688:12345-0@lo:400:kworker.0 Request processed in 32us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378336.530978:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787378336.530990:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787378336.530995:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874201626642816:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787378336.531035:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874201626642816:12345-0@lo:8:kworker.0 Request processed in 38us (1417us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787378336.531040:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1787378336.531183:0:15545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:1.0:1787378336.531364:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:1.0:1787378336.531377:0:15535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787378336.531401:0:15535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787378336.531417:0:15535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7853eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ef6 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.531430:0:15535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb81485c00/0xdd3c5462d7853eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853ef6 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787378336.531483:0:15535:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787378336.531486:0:15535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787378336.531487:0:15535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378336.531488:0:15535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378336.531489:0:15535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378336.531491:0:15535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378336.531492:0:15535:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378336.531494:0:15535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378336.531495:0:15535:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787378336.531499:0:15535:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787378336.531502:0:15535:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787378336.531503:0:15535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787378336.531504:0:15535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787378336.531505:0:15535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787378336.531506:0:15535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787378336.531507:0:15535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787378336.531508:0:15535:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787378336.531509:0:15535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787378336.531510:0:15535:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787378336.531529:0:15535:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787378336.531547:0:15535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626643200:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787378336.531606:0:15535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378336.531636:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626643200 00000100:00100000:1.0:1787378336.531646:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626643200 00000100:00100000:1.0:1787378336.531675:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787378336.531681:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:15535:x1874201626643200:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787378336.531701:0:14222:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787378336.531713:0:14222:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787378336.532124:0:15535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb83b87cc0 going to sleep for 11 seconds 00010000:00080000:3.0:1787378336.532318:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eebae6f9500 x1874201626642944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378336.532332:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626642944:0@lo:400:kworker.0 00000100:00100000:3.0:1787378336.532346:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787378336.532363:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626642688:0@lo:400:kworker.0 00000100:00100000:3.0:1787378336.532400:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787378336.532405:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787378336.532410:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787378336.532413:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626642816:0@lo:8:kworker.0 20000000:01000000:0.0:1787378336.573128:0:14222:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787378336.573177:0:14222:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787378336.573454:0:14244:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787378336.573459:0:14244:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787378336.573480:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.573497:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 19 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.573505:0:14244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.573541:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 19 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.573555:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 19 pid: 14223 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378336.573576:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1874201626643328:0@lo:104: 00000100:00100000:1.0:1787378336.573635:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378336.573709:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914540 going to sleep for 11 seconds 00000100:00100000:0.0:1787378336.576862:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626643328 00000100:00100000:0.0:1787378336.576877:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626643328 00000100:00100000:0.0:1787378336.576931:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787378336.576940:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:14244:x1874201626643328:12345-0@lo:104: 00010000:00010000:0.0:1787378336.576958:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378336.577041:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787378336.577060:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:14244:x1874201626643328:12345-0@lo:104: Request processed in 121us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378336.577067:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787378336.577130:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787378336.577136:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577143:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640800 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:2.0:1787378336.577147:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577156:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787378336.577163:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787378336.577169:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787378336.577210:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577216:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787378336.577236:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577254:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eebbf640800/0xdd3c5462d7853dde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853de5 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577270:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378336.577272:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378336.577273:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378336.577288:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3312:1874201626643456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787378336.577334:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378336.577387:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626643456 00000100:00100000:2.0:1787378336.577391:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626643456 00010000:00010000:2.0:1787378336.577410:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 20 pid: 14223 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378336.577430:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378336.577437:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+20:3312:x1874201626643456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787378336.577447:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378336.577452:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 20 pid: 14223 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577463:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 20 pid: 14223 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577481:0:14215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577489:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787378336.577503:0:14215:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004044500s 00010000:00010000:2.0:1787378336.577514:0:14215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577521:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577527:0:14215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577533:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577539:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378336.577543:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577550:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577559:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378336.577634:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378336.577663:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+20:3312:x1874201626643456:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378336.577670:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378336.577706:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3312:1874201626643456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787378336.579850:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7853de5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7853dde expref: 19 pid: 14223 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378336.579869:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1874201626643328:0@lo:104: 00010000:00010000:1.0:1787378336.579891:0:14244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.579913:0:14244:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.579919:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378336.579927:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebbf640600/0xdd3c5462d7853f12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378336.581473:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:15535:x1874201626643200:12345-0@lo:253:mount.lustre.0 Request processed in 49785us (49860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378336.581487:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787378336.581580:0:15535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606b5901-a2d8-4f42-a60c-6eb8ab84a876:15535:1874201626643200:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787378336.581593:0:15535:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787378336.581596:0:15535:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787378336.581598:0:15535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787378336.581599:0:15535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787378336.581600:0:15535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787378336.581601:0:15535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787378336.581602:0:15535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787378336.581604:0:15535:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787378336.581606:0:15535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787378336.581607:0:15535:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787378336.581619:0:15535:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787378336.585067:0:15535:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378336.585251:0:15535:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378336.586070:0:15535:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378336.586238:0:15535:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787378336.586412:0:15535:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787378336.586703:0:15535:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787378336.587485:0:15535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787378336.702351:0:15535:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787378336.702370:0:15535:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787378336.702400:0:15535:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787378336.702578:0:15535:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787378336.702611:0:15535:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787378336.702641:0:15535:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787378336.794795:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378337.306938:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626643584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787378337.307021:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378337.307237:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626643584 00000100:00100000:2.0:1787378337.307259:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626643584 00000100:00100000:2.0:1787378337.307321:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378337.307331:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626643584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787378337.307369:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378337.307422:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626643584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378337.307430:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378337.307476:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626643584:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787378337.821438:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787378338.210805:0:14225:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787378338.210811:0:14225:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9eebbc37f000 from 8 10000000:01000000:1.0:1787378338.210816:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787378338.210875:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640a00/0xdd3c5462d7853f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378338.210888:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eebbf640a00/0xdd3c5462d7853f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378338.210897:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eebbf640a00/0xdd3c5462d7853f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378338.210923:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626643712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787378338.210985:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378338.211023:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626643712 00000100:00100000:1.0:1787378338.211030:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626643712 00000100:00100000:1.0:1787378338.211073:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787378338.211095:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:14225:x1874201626643712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378338.211108:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378338.211121:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf640000/0xdd3c5462d7853f20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d7853f19 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378338.211141:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf640000/0xdd3c5462d7853f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d7853f19 expref: 19 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378338.211152:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf640000/0xdd3c5462d7853f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853f19 expref: 19 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378338.211160:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf640000, rc 0) 00000100:00100000:1.0:1787378338.211193:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:14225:x1874201626643712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378338.211199:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787378338.211255:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89b43b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378338.211275:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626643712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787378338.211291:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eebbf640a00/0xdd3c5462d7853f19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853f20 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378338.211311:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eebbf640a00/0xdd3c5462d7853f19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7853f20 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378338.211359:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626643840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787378338.211388:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378338.211407:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626643840 00000100:00100000:1.0:1787378338.211410:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626643840 00000100:00100000:1.0:1787378338.211431:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787378338.211444:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb90542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:14225:x1874201626643840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787378338.211458:0:14222:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787378338.211474:0:14222:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787378338.211477:0:14222:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787378338.211546:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb90542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:14225:x1874201626643840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378338.211566:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787378338.211592:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89b43b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787378338.211604:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626643840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787378338.211654:0:14225:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787378338.211660:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eebbf640a00/0xdd3c5462d7853f19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853f20 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378338.211668:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eebbf640a00/0xdd3c5462d7853f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7853f20 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378338.843890:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787378339.546436:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787378339.871009:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378340.897835:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378341.918184:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378341.925034:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3314:1874201626643968:0@lo:400:kworker.0 00000100:00100000:0.0:1787378341.925117:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787378341.925192:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787378341.925196:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787378341.925199:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787378341.925207:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eebbc248800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787378341.925238:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eebad2e0700 x1874201626644224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787378341.925286:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787378341.925293:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626644480:0@lo:400:kworker.0 00000100:00100000:0.0:1787378341.925326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378341.925359:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626644608:0@lo:400:kworker.0 00000100:00100000:0.0:1787378341.925381:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378341.927575:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626644224:0@lo:8:kworker.0 00000100:00100000:3.0:1787378341.927636:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378341.927913:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626644224 00000100:00100000:0.0:1787378341.927921:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626644224 00000100:00100000:1.0:1787378341.927932:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626643968 00000100:00100000:1.0:1787378341.927937:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626643968 00000100:00100000:1.0:1787378341.927965:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787378341.927965:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787378341.927973:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3314:x1874201626643968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378341.927973:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874201626644224:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787378341.927997:0:14866:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1787378341.928024:0:14866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd3c5462d7853f27 00000100:00100000:1.0:1787378341.928026:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3314:x1874201626643968:12345-0@lo:400:kworker.0 Request processed in 54us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378341.928033:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00002000:00100000:0.0:1787378341.928036:0:14866:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9eea8281e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113675 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787378341.928039:0:14866:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787378341.928042:0:14866:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787378341.928069:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626644480 00000100:00100000:1.0:1787378341.928073:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626644480 00000100:00100000:1.0:1787378341.928111:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626644608 00000100:00100000:1.0:1787378341.928115:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626644608 00000100:00100000:1.0:1787378341.928127:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787378341.928146:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626644480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378341.928178:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874201626644480:12345-0@lo:400:kworker.0 Request processed in 33us (2852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378341.928184:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787378341.928196:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787378341.928201:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626644608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378341.928226:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626644608:12345-0@lo:400:kworker.0 Request processed in 25us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378341.928231:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787378341.928283:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebad2e3b80 x1874201626644608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378341.928297:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626644608:0@lo:400:kworker.0 00010000:00080000:1.0:1787378341.928309:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebad2e1880 x1874201626644480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787378341.928317:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874201626644480:0@lo:400:kworker.0 00000100:00100000:1.0:1787378341.928326:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3314:1874201626643968:0@lo:400:kworker.0 00000100:00080000:1.0:1787378341.928349:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:0.0:1787378341.928370:0:14866:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787378341.928393:0:14866:0:(import.c:65:import_set_state_nolock()) ffff9eea8281a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378341.928428:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874201626644224:12345-0@lo:8:kworker.0 Request processed in 455us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378341.928434:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787378341.928500:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebad2e0700 x1874201626644224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787378366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787378341.928510:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787378341.928518:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787378341.928530:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787378341.928532:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9eebbc248800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787378341.928551:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787378341.928556:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874201626644224:0@lo:8:kworker.0 00000100:00100000:2.0:1787378341.928737:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626644096:0@lo:400:kworker.0 00000100:00100000:2.0:1787378341.928771:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378341.928797:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787378341.928802:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626644352:0@lo:400:kworker.0 00000100:00100000:2.0:1787378341.928822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378341.928848:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626644352 00000100:00100000:2.0:1787378341.928851:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626644352 00000100:00100000:2.0:1787378341.928873:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787378341.928879:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626644352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378341.928911:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626644352:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378341.928916:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787378341.928931:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626644096 00000100:00100000:2.0:1787378341.928940:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626644096 00000100:00100000:2.0:1787378341.928966:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378341.928971:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626644096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378341.928996:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626644096:12345-0@lo:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378341.929001:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787378341.929025:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebad2e2d80 x1874201626644352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787378357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787378341.929033:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626644352:0@lo:400:kworker.0 00000100:00100000:2.0:1787378341.929042:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626644096:0@lo:400:kworker.0 00000100:00080000:2.0:1787378341.929055:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787378341.929644:0:14253:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787378341.929662:0:14253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14253:1874201626644864:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787378341.929692:0:14253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378341.929708:0:14253:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939bd80 going to sleep for 11 seconds 00000004:00080000:0.0:1787378341.929736:0:14252:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787378341.930117:0:14252:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 478192396780ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787378341.930199:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626644736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378341.930231:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378341.930281:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626644864 00000100:00100000:3.0:1787378341.930287:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626644864 00000100:00100000:3.0:1787378341.930327:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787378341.930334:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14253:x1874201626644864:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787378341.932677:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626644736 00000100:00100000:0.0:1787378341.932689:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626644736 00000100:00100000:0.0:1787378341.932752:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787378341.932762:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626644736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378341.932792:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378341.932866:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626644736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378341.932874:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00080000:3.0:1787378341.934118:0:14864:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787378341.934127:0:14864:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787378341.934132:0:14864:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:0.0:1787378341.942444:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787378341.946811:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eebad2e2680 x1874201626644736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787378357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787378341.946838:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626644736:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1787378341.947252:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.947260:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.947284:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.947289:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.947294:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.947309:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.947327:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.947334:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.947361:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787378341.947990:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.947997:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948005:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.948008:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.948012:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948021:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948028:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948035:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948059:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787378341.948068:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787378341.948074:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948081:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484a00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.948085:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948093:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948110:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948116:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948131:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.948134:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948140:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.948143:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948160:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948169:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948175:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948185:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.948187:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.948188:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.948568:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.948574:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948582:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.948586:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.948590:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948599:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948606:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948619:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948633:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.948642:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.948646:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948652:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.948655:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948662:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948674:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948681:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.948694:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.948696:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.948697:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.949122:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.949133:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949141:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.949144:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.949148:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949157:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949164:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949172:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949184:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.949191:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.949193:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949199:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.949203:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949209:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949223:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949230:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.949242:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.949243:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.949245:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378341.952292:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.967457:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.967469:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967485:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.967490:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.967495:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967508:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967518:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967535:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967565:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.967578:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.967583:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967591:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.967596:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967604:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967621:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967629:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b21bca5/0xdd3c5462d7853f4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.967645:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.967646:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.967648:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.968063:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.968069:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968078:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.968085:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.968089:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968099:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968107:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968114:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968129:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.968137:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.968141:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968147:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.968150:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968156:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968165:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968181:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f43fc7c/0xdd3c5462d7853f51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968194:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.968196:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.968197:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.968562:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.968567:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968575:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.968578:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.968582:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968590:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968597:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968603:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968618:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.968627:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.968636:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968644:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.968648:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968656:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968668:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968674:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4f09cfa/0xdd3c5462d7853f58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.968687:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.968689:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.968690:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.969093:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.969099:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969107:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.969110:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.969114:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969132:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969139:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969146:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969158:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.969166:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.969169:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969175:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.969179:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969185:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969195:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969202:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b84bc835/0xdd3c5462d7853f5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.969220:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.969221:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.969222:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.974163:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.974176:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974192:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.974197:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.974203:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974216:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974225:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974232:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974251:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.974262:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.974268:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974298:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb80030600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.974303:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974311:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974327:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974333:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b534351/0xdd3c5462d7853f66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.974353:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.974355:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.974357:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.979855:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.979868:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.979886:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.979890:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.979896:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.979910:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.979927:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.979935:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.979958:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.979975:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.979981:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.979989:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb80031800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.979994:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980003:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980019:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980026:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2c6d7c6/0xdd3c5462d7853f6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980047:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.980054:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.980056:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.980437:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.980443:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980451:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.980454:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.980458:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980467:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980474:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980481:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980495:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.980502:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.980506:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.980513:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb80031000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.980516:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.983607:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.983629:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.983636:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001640991c/0xdd3c5462d7853f74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.983658:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.983660:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.983662:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.984244:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.984251:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984264:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.984449:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.984460:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984473:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984483:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984497:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984527:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787378341.984944:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.984949:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984958:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.984961:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.984965:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984974:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984982:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.984988:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985003:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787378341.985017:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787378341.985022:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985036:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.985040:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985049:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985062:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985069:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a2bffad/0xdd3c5462d7853f7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985084:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.985089:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985095:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.985099:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985106:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985115:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985128:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cce2c84/0xdd3c5462d7853f82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985139:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.985140:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.985142:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.985534:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.985541:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985550:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.985553:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.985558:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985567:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985574:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985582:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985596:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.985604:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.985612:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985618:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.985622:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985628:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985639:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985645:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a5bb0d/0xdd3c5462d7853f89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.985658:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.985659:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.985661:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.986044:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.986050:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986059:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.986061:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.986065:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986087:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986094:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986100:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986113:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.986121:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.986125:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986131:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81484a00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.986135:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986142:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986151:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986159:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc01531e/0xdd3c5462d7853f90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986181:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.986183:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.986184:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.986594:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.986600:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986608:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.986610:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.986615:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986623:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986630:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986637:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986650:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.986656:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.986660:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986676:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eea82e12600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.986679:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986686:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986697:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986704:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a7adf97/0xdd3c5462d7853f97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.986716:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.986737:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.986738:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378341.987081:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378341.987086:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987094:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378341.987097:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378341.987101:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987109:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987122:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987129:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987140:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787378341.987147:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378341.987149:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987155:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eea82e13000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378341.987158:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987166:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987175:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987182:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000863415b8/0xdd3c5462d7853f9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378341.987194:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.987199:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378341.987201:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378341.990176:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378342.001324:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378342.001337:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.001353:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378342.001357:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378342.001364:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.001377:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.001386:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.001394:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.001423:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787378342.002005:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378342.002012:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002021:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378342.002023:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378342.002028:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002043:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002052:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002061:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002076:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787378342.002457:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378342.002463:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002470:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378342.002473:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378342.002477:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002485:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002493:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002511:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.002519:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787378342.002758:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787378342.002766:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002774:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eea82e12e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378342.002779:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002788:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002807:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002815:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc43557f/0xdd3c5462d7853fa5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002847:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787378342.002850:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002857:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eea82e12800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378342.002860:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002866:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002877:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002882:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c7996e1/0xdd3c5462d7853fac lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002893:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378342.002895:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002900:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eea82e12a00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378342.002903:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002918:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002927:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002933:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041cadfee/0xdd3c5462d7853fb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.002944:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378342.002945:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378342.002946:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378342.003593:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787378342.007309:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787378342.007322:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.007337:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787378342.007342:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787378342.007348:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.007362:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.007372:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.007379:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.007413:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787378342.008653:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378342.008665:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.008676:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eea82e12000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378342.008693:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.008703:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.008739:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.008746:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f85bfd06/0xdd3c5462d7853fba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.008771:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378342.008773:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378342.008774:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787378342.012075:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787378342.012089:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.012105:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787378342.012110:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378342.012116:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.012131:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.012141:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.012160:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.012186:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787378342.012623:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787378342.012631:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.012640:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378342.012644:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.012653:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.012669:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.012681:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d82cf02/0xdd3c5462d7853fc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378342.012697:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378342.012699:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378342.012700:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787378342.015087:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787378342.015100:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.015116:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787378342.015121:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378342.015127:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.015140:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.015150:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.015157:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.015182:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787378342.015925:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378342.015933:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.015943:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378342.015948:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.015957:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.015975:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.015995:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fadeaef/0xdd3c5462d7853fc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378342.016015:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378342.016016:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378342.016018:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787378342.016386:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787378342.017607:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787378342.017619:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.017639:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787378342.017642:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378342.017648:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.017659:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.017668:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.017675:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.017698:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787378342.018126:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787378342.018133:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018141:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787378342.018144:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378342.018149:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018158:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018176:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018184:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018197:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787378342.018579:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787378342.018585:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018593:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787378342.018596:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378342.018599:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018607:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018613:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018619:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.018638:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787378342.019030:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787378342.019036:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.019044:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787378342.019047:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378342.019051:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.019059:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.019067:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.019073:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378342.019081:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1787378342.019226:0:14864:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:3.0:1787378342.019601:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787378342.019608:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019623:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378342.019628:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019636:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019652:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019659:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b240a050/0xdd3c5462d7853fcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019674:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787378342.019677:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019682:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378342.019685:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019692:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019699:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019712:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b63e44c/0xdd3c5462d7853fd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019745:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787378342.019748:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019754:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378342.019757:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019764:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019774:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019780:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000711e82fa/0xdd3c5462d7853fdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019789:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378342.019792:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019798:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc0000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378342.019805:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019813:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019822:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019830:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dce79c16/0xdd3c5462d7853fe4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378342.019840:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378342.019841:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378342.019843:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378342.024871:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14253:x1874201626644864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94529us (95169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378342.024885:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787378342.025282:0:14253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14253:1874201626644864:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787378342.025297:0:14253:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787378342.025347:0:14253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14253:1874201626644992:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787378342.025388:0:14253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378342.025428:0:14253:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939bd80 going to sleep for 11 seconds 00010000:00010000:0.0:1787378342.025443:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378342.025608:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626644992 00000100:00100000:2.0:1787378342.025623:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626644992 00000100:00100000:2.0:1787378342.025670:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787378342.025679:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14253:x1874201626644992:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787378342.025804:0:14866:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787378342.044682:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14253:x1874201626644992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18997us (19287us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787378342.044693:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787378342.045024:0:14253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14253:1874201626644992:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787378342.045038:0:14253:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1787378342.426212:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787378342.426239:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626645120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378342.426326:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378342.426615:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626645120 00000100:00100000:2.0:1787378342.426624:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626645120 00000100:00100000:2.0:1787378342.426677:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378342.426687:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626645120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787378342.426738:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378342.426791:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626645120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378342.426798:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378342.426842:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626645120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787378342.937902:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787378343.740159:0:15889:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787378343.972771:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378344.988181:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378346.009860:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378346.026149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.026265:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604629248 00000100:00100000:2.0:1787378346.026276:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604629248 00000100:00100000:2.0:1787378346.026323:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:2.0:1787378346.026332:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1874201604629248:12345-192.168.203.22@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787378346.026358:0:14223:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 54a947f4-9814-4d6d-b4bb-f4a52d36ad66@192.168.203.22@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1787378346.026383:0:14223:0:(genops.c:1406:class_connect()) connect: client 54a947f4-9814-4d6d-b4bb-f4a52d36ad66, cookie 0xdd3c5462d7853feb 00000100:00080000:2.0:1787378346.026547:0:14223:0:(import.c:65:import_set_state_nolock()) ffff9eebbf740000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378346.026616:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+5:2352:x1874201604629248:12345-192.168.203.22@tcp:250:mount.lustre.0 Request processed in 283us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.026624:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:1.0:1787378346.060266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378346.060352:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604629376 00000100:00100000:3.0:1787378346.060361:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604629376 00000100:00100000:3.0:1787378346.060421:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:3.0:1787378346.060431:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+5:13727:x1874201604629376:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787378346.060450:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378346.060467:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eea82e13000/0xdd3c5462d7853ff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a71d8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.060499:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eea82e13000/0xdd3c5462d7853ff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71d8 expref: 6 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.060540:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eea82e13000/0xdd3c5462d7853ff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71d8 expref: 6 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.060550:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e13000, rc 0) 00000100:00100000:3.0:1787378346.060609:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+6:13727:x1874201604629376:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 179us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378346.060616:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:3.0:1787378346.062814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378346.062920:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604629504 00000100:00100000:1.0:1787378346.062929:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604629504 00000100:00100000:1.0:1787378346.062980:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:1.0:1787378346.062990:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+6:13727:x1874201604629504:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787378346.063359:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+6:13727:x1874201604629504:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 368us (553us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787378346.063369:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:0.0:1787378346.075598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378346.075817:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604629632 00000100:00100000:1.0:1787378346.075828:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604629632 00000100:00100000:1.0:1787378346.075885:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:1.0:1787378346.075896:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+6:13727:x1874201604629632:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787378346.075924:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378346.075942:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf641000/0xdd3c5462d7853ff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a71df expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378346.075968:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641000/0xdd3c5462d7853ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71df expref: 7 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378346.075981:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf641000/0xdd3c5462d7853ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a71df expref: 7 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378346.075991:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641000, rc 0) 00000100:00100000:1.0:1787378346.076051:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+7:13727:x1874201604629632:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 157us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.076058:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:2.0:1787378346.079857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378346.079943:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604629760 00000100:00100000:3.0:1787378346.079952:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604629760 00000100:00100000:3.0:1787378346.080005:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:3.0:1787378346.080014:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+7:13727:x1874201604629760:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787378346.080316:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+8:13727:x1874201604629760:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 302us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378346.080324:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:3.0:1787378346.085305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.085606:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604629888 00000100:00100000:2.0:1787378346.085616:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604629888 00000100:00100000:2.0:1787378346.085671:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:2.0:1787378346.085681:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+8:13727:x1874201604629888:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787378346.086088:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+8:13727:x1874201604629888:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 407us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.086096:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1787378346.103038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378346.103235:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604630016 00000100:00100000:1.0:1787378346.103254:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604630016 00000100:00100000:1.0:1787378346.103310:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:1.0:1787378346.103319:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+8:13746:x1874201604630016:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787378346.103659:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+8:13746:x1874201604630016:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 339us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.103667:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:1.0:1787378346.131585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378346.131748:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604630144 00000100:00100000:3.0:1787378346.131759:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604630144 00000100:00100000:3.0:1787378346.131810:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:3.0:1787378346.131819:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+8:13746:x1874201604630144:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787378346.132093:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+8:13746:x1874201604630144:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 273us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378346.132101:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:3.0:1787378346.150602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.150856:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604630272 00000100:00100000:2.0:1787378346.150867:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604630272 00000100:00100000:2.0:1787378346.150925:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1787378346.150936:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+8:13727:x1874201604630272:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787378346.150953:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378346.150969:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc0e00/0xdd3c5462d7854000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7209 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378346.150996:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc0e00/0xdd3c5462d7854000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7209 expref: 9 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378346.151008:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc0e00/0xdd3c5462d7854000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7209 expref: 9 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378346.151017:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0e00, rc 0) 00000100:00100000:2.0:1787378346.151077:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+9:13727:x1874201604630272:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 143us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.151083:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:0.0:1787378346.157199:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378346.157308:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604630400 00000100:00100000:1.0:1787378346.157318:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604630400 00000100:00100000:1.0:1787378346.157376:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:1.0:1787378346.157386:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+9:13727:x1874201604630400:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787378346.157412:0:14223:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787378346.157441:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787378346.157445:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787378346.157448:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787378346.157451:0:14223:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787378346.159087:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+9:13727:x1874201604630400:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 1693us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.159108:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:3.0:1787378346.161827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378346.161948:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604630528 00000100:00100000:1.0:1787378346.161960:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604630528 00000100:00100000:1.0:1787378346.162014:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:1.0:1787378346.162024:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+9:13727:x1874201604630528:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787378346.162041:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378346.162062:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7210 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378346.162089:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 10 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378346.162100:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 10 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378346.162109:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641200, rc 0) 00000100:00100000:1.0:1787378346.162210:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13727:x1874201604630528:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 185us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.162217:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:0.0:1787378346.168421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.168560:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604630656 00000100:00100000:2.0:1787378346.168570:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604630656 00000100:00100000:2.0:1787378346.168625:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:2.0:1787378346.168634:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13727:x1874201604630656:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787378346.168953:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13727:x1874201604630656:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 318us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.168962:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:3.0:1787378346.172973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.173117:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604630784 00000100:00100000:2.0:1787378346.173126:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604630784 00000100:00100000:2.0:1787378346.173188:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:2.0:1787378346.173198:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13727:x1874201604630784:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787378346.173859:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13727:x1874201604630784:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 659us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.173869:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:3.0:1787378346.179394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378346.179515:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604630912 00000100:00100000:1.0:1787378346.179527:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604630912 00000100:00100000:1.0:1787378346.179587:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:1.0:1787378346.179597:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13752:x1874201604630912:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787378346.179912:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13752:x1874201604630912:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 315us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.179931:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:0.0:1787378346.182430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.182666:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604631040 00000100:00100000:2.0:1787378346.182675:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604631040 00000100:00100000:2.0:1787378346.182753:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:2.0:1787378346.182764:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbac73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13752:x1874201604631040:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787378346.187761:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbac73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13752:x1874201604631040:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 4983us (5324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.187777:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:3.0:1787378346.203565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.203893:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604631168 00000100:00100000:2.0:1787378346.203904:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604631168 00000100:00100000:2.0:1787378346.203972:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1787378346.203979:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1874201604631168:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787378346.204010:0:14229:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 00d50ef6-d535-4a72-b1e6-41488fdde5e5@192.168.203.22@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1787378346.204070:0:14229:0:(genops.c:1406:class_connect()) connect: client 00d50ef6-d535-4a72-b1e6-41488fdde5e5, cookie 0xdd3c5462d785400e 00000004:00100000:2.0:1787378346.204098:0:14229:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787378346.204104:0:14229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787378346.251981:0:14229:0:(import.c:65:import_set_state_nolock()) ffff9eea8281c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787378346.252135:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2352:x1874201604631168:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 48153us (48578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378346.252146:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1787378346.255215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378346.255339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378346.255602:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604631296 00000100:00100000:1.0:1787378346.255612:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604631296 00000100:00100000:1.0:1787378346.255677:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604631424 00000100:00100000:1.0:1787378346.255680:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604631424 00000100:00100000:1.0:1787378346.255697:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787378346.255706:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:0:x1874201604631296:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787378346.255781:0:14228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787378346.255868:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:0:x1874201604631296:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 161us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.255876:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787378346.255898:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787378346.255905:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:13727:x1874201604631424:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787378346.255916:0:14228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787378346.255936:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:13727:x1874201604631424:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 32us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.255942:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00080000:0.0:1787378346.256248:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378346.257696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378346.257853:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604631552 00000100:00100000:1.0:1787378346.257862:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604631552 00000100:00100000:1.0:1787378346.257953:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787378346.257963:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:13727:x1874201604631552:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787378346.258050:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:13727:x1874201604631552:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 88us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.258058:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1787378346.264225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.264281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.264315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.264351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378346.264380:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604631680 00000100:00100000:2.0:1787378346.264389:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604631680 00000100:00100000:2.0:1787378346.264422:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604631808 00000100:00100000:2.0:1787378346.264425:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604631808 00000100:00100000:2.0:1787378346.264438:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1787378346.264446:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874201604631680:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787378346.264488:0:14865:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 00d50ef6-d535-4a72-b1e6-41488fdde5e5@192.168.203.22@tcp t0 exp 0000000000000000 cur 482 last 0 00000100:00100000:0.0:1787378346.264766:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604631936 00000100:00100000:0.0:1787378346.264771:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604631936 00000100:00100000:0.0:1787378346.264802:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1787378346.264810:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:13727:x1874201604631936:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787378346.265340:0:14231:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 473us 00000020:00000080:2.0:1787378346.265664:0:14865:0:(genops.c:1406:class_connect()) connect: client 00d50ef6-d535-4a72-b1e6-41488fdde5e5, cookie 0xdd3c5462d7854015 00002000:00100000:2.0:1787378346.265676:0:14865:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 00d50ef6-d535-4a72-b1e6-41488fdde5e5/ffff9eebbf744800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787378346.265698:0:14865:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787378346.265974:0:14865:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787378346.266005:0:14865:0:(import.c:65:import_set_state_nolock()) ffff9eebbf747800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787378346.266246:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604632064 00000100:00100000:1.0:1787378346.266253:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604632064 00000100:00100000:1.0:1787378346.266292:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:1.0:1787378346.266300:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:2353:x1874201604632064:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378346.266359:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:2353:x1874201604632064:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 59us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.266367:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:2.0:1787378346.266536:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2352:x1874201604631680:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 2089us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.266544:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1787378346.266561:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787378346.266576:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874201604631808:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787378346.266600:0:14865:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 00d50ef6-d535-4a72-b1e6-41488fdde5e5@192.168.203.22@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1787378346.266621:0:14865:0:(genops.c:1406:class_connect()) connect: client 00d50ef6-d535-4a72-b1e6-41488fdde5e5, cookie 0xdd3c5462d785401c 00002000:00100000:2.0:1787378346.266628:0:14865:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 00d50ef6-d535-4a72-b1e6-41488fdde5e5/ffff9eebbf745000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787378346.266643:0:14865:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787378346.266790:0:14865:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787378346.266809:0:14865:0:(import.c:65:import_set_state_nolock()) ffff9eebbf746800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378346.266834:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2352:x1874201604631808:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 257us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378346.266840:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000004:00200000:1.0:1787378346.287945:0:14231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787378346.288132:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:13727:x1874201604631936:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 23317us (23912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378346.288147:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787378346.495910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378346.496072:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604632192 00000100:00100000:3.0:1787378346.496082:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604632192 00000100:00100000:3.0:1787378346.496144:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787378346.496154:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:13773:x1874201604632192:12345-192.168.203.22@tcp:101:mkdir.0 00010000:00010000:3.0:1787378346.496176:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378346.496202:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12600/0xdd3c5462d7854023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a723a expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.496278:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12c00/0xdd3c5462d785402a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.496291:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12c00/0xdd3c5462d785402a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.496305:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12c00/0xdd3c5462d785402a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378346.496517:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787378346.496521:0:14230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378346.496617:0:14230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12c00/0xdd3c5462d785402a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.496655:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12600/0xdd3c5462d7854023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a723a expref: 8 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.496673:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12c00/0xdd3c5462d785402a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a723a expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378346.496693:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb916d9b00) 00010000:00010000:3.0:1787378346.496696:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378346.496700:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e12c00, rc 0) 00000100:00100000:3.0:1787378346.497250:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:13773:x1874201604632192:12345-192.168.203.22@tcp:101:mkdir.0 Request processed in 1085us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378346.497260:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1787378347.034487:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626645632:0@lo:400:kworker.0 00000100:00100000:0.0:1787378347.034579:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378347.034635:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787378347.034641:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626645504:0@lo:400:kworker.0 00000100:00100000:0.0:1787378347.034666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378347.034703:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626645504 00000100:00100000:0.0:1787378347.034711:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626645504 00000100:00100000:0.0:1787378347.034781:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787378347.034790:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874201626645504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787378347.034855:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874201626645504:12345-0@lo:400:kworker.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378347.034862:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787378347.034882:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787378347.034911:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626645504:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.037519:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626645248:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.037591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378347.037629:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626645760:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.037655:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378347.037681:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787378347.037687:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626645376:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.037710:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378347.037745:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626645888:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.037768:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378347.037795:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626645376 00000100:00100000:2.0:1787378347.037801:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626645376 00000100:00100000:2.0:1787378347.037847:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378347.037857:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626645376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.037908:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626645376:12345-0@lo:400:kworker.0 Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378347.037927:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787378347.037949:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626645248 00000100:00100000:2.0:1787378347.037954:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626645248 00000100:00100000:2.0:1787378347.037977:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787378347.037982:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3313:x1874201626645248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.038013:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3313:x1874201626645248:12345-0@lo:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378347.038019:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1787378347.038045:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378347.038074:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626645376:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.038083:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626645248:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.038107:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626645632 00000100:00100000:2.0:1787378347.038110:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626645632 00000100:00100000:2.0:1787378347.038129:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626645760 00000100:00100000:2.0:1787378347.038132:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626645760 00000100:00100000:2.0:1787378347.038149:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626645888 00000100:00100000:2.0:1787378347.038151:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626645888 00000100:00100000:2.0:1787378347.038166:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378347.038171:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626645632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.038207:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874201626645632:12345-0@lo:400:kworker.0 Request processed in 35us (3628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378347.038213:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787378347.038224:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787378347.038230:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626645760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.038270:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626645760:12345-0@lo:400:kworker.0 Request processed in 41us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378347.038288:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787378347.038300:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787378347.038306:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626645888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.038332:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874201626645888:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378347.038338:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787378347.038351:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787378347.038372:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874201626645632:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.038398:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874201626645888:0@lo:400:kworker.0 00000100:00100000:2.0:1787378347.038406:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626645760:0@lo:400:kworker.0 00010000:00010000:2.0:1787378347.044027:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378347.044307:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626646016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378347.044374:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378347.044462:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626646016 00000100:00100000:0.0:1787378347.044469:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626646016 00000100:00100000:0.0:1787378347.044526:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787378347.044534:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626646016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378347.044568:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378347.044612:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874201626646016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378347.044621:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787378347.044667:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626646016:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787378347.122204:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787378347.122221:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00d50ef6-d535-4a72-b1e6-41488fdde5e5 00000001:00080000:0.0:1787378347.122231:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1787378347.546385:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787378347.546410:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626646144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787378347.546487:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378347.546832:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626646144 00000100:00100000:2.0:1787378347.546841:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626646144 00000100:00100000:2.0:1787378347.546892:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787378347.546911:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626646144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787378347.546934:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378347.546984:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626646144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378347.546990:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378347.547176:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626646144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787378348.058115:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787378348.120417:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00d50ef6-d535-4a72-b1e6-41488fdde5e5 00000100:00100000:3.0:1787378348.539512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378348.539661:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604632320 00000100:00100000:2.0:1787378348.539670:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604632320 00000100:00100000:2.0:1787378348.539792:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787378348.539803:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:13826:x1874201604632320:12345-192.168.203.22@tcp:41:lfs.0 00000004:00000024:2.0:1787378348.539844:0:14229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787378348.539930:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:13826:x1874201604632320:12345-192.168.203.22@tcp:41:lfs.0 Request processed in 127us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.539937:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00080000:0.0:1787378348.540314:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378348.544440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378348.544549:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604632448 00000100:00100000:2.0:1787378348.544560:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604632448 00000100:00100000:2.0:1787378348.544629:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787378348.544638:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:13826:x1874201604632448:12345-192.168.203.22@tcp:13:lfs.0 00002000:00000024:2.0:1787378348.544676:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378348.544795:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:13826:x1874201604632448:12345-192.168.203.22@tcp:13:lfs.0 Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.544802:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00080000:0.0:1787378348.544994:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378348.548890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378348.548975:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604632576 00000100:00100000:2.0:1787378348.548986:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604632576 00000100:00100000:2.0:1787378348.549089:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1787378348.549099:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:13826:x1874201604632576:12345-192.168.203.22@tcp:13:lfs.0 00002000:00000024:2.0:1787378348.549134:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378348.549232:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:13826:x1874201604632576:12345-192.168.203.22@tcp:13:lfs.0 Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.549240:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00080000:0.0:1787378348.549618:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378348.855557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378348.855670:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604632704 00000100:00100000:3.0:1787378348.855680:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604632704 00000100:00100000:3.0:1787378348.855771:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:3.0:1787378348.855782:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+10:13859:x1874201604632704:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787378348.855800:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378348.855819:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eea82e12600/0xdd3c5462d7854031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7241 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378348.855849:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eea82e12600/0xdd3c5462d7854031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7241 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378348.855860:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eea82e12600/0xdd3c5462d7854031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7241 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378348.855870:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e12600, rc 0) 00000100:00100000:3.0:1787378348.855923:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13859:x1874201604632704:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 144us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378348.855929:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:1.0:1787378348.861910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378348.862009:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604632832 00000100:00100000:2.0:1787378348.862020:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604632832 00000100:00100000:2.0:1787378348.862073:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:2.0:1787378348.862083:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13859:x1874201604632832:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787378348.862385:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13859:x1874201604632832:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 302us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.862393:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:1.0:1787378348.869043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378348.869144:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604632960 00000100:00100000:2.0:1787378348.869154:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604632960 00000100:00100000:2.0:1787378348.869208:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:2.0:1787378348.869217:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13859:x1874201604632960:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787378348.869483:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13859:x1874201604632960:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 265us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.869491:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:1.0:1787378348.874090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378348.874183:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604633088 00000100:00100000:3.0:1787378348.874207:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604633088 00000100:00100000:3.0:1787378348.874268:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:3.0:1787378348.874278:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13865:x1874201604633088:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787378348.874563:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13865:x1874201604633088:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 286us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378348.874571:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:0.0:1787378348.893882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378348.893986:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604633216 00000100:00100000:1.0:1787378348.893998:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604633216 00000100:00100000:1.0:1787378348.894067:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:1.0:1787378348.894078:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13865:x1874201604633216:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787378348.894499:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13865:x1874201604633216:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 422us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378348.894518:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:1.0:1787378348.903919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378348.904899:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604633344 00000100:00100000:2.0:1787378348.904910:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604633344 00000100:00100000:2.0:1787378348.904965:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:2.0:1787378348.904975:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13859:x1874201604633344:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787378348.904990:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378348.905007:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7854038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a726b expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378348.905140:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7854038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a726b expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378348.905152:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc1e00/0xdd3c5462d7854038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a726b expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378348.905163:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1e00, rc 0) 00000100:00100000:2.0:1787378348.905233:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13859:x1874201604633344:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 250us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.905255:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:2.0:1787378348.917435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378348.917627:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604633472 00000100:00100000:1.0:1787378348.917650:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604633472 00000100:00100000:1.0:1787378348.917761:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:1.0:1787378348.917771:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13859:x1874201604633472:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787378348.917796:0:14223:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787378348.917813:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787378348.917818:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787378348.917821:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787378348.917824:0:14223:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787378348.929685:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13859:x1874201604633472:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 11905us (12247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.929698:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:2.0:1787378348.937932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378348.938044:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604633600 00000100:00100000:0.0:1787378348.938054:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604633600 00000100:00100000:0.0:1787378348.938114:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:0.0:1787378348.938125:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13859:x1874201604633600:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787378348.938141:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378348.938158:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7272 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378348.938186:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 13 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378348.938212:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 13 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378348.938231:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b800, rc 0) 00000100:00100000:0.0:1787378348.938287:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13859:x1874201604633600:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 163us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378348.938294:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:3.0:1787378348.940441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378348.940636:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604633728 00000100:00100000:2.0:1787378348.940644:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604633728 00000100:00100000:2.0:1787378348.940695:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:2.0:1787378348.940704:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13859:x1874201604633728:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787378348.941578:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13859:x1874201604633728:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 870us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.941588:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:1.0:1787378348.952421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378348.956603:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604633856 00000100:00100000:3.0:1787378348.956618:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604633856 00000100:00100000:3.0:1787378348.956687:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:3.0:1787378348.956698:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13859:x1874201604633856:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787378348.956954:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13859:x1874201604633856:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 257us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378348.956962:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:1.0:1787378348.959807:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378348.960111:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604633984 00000100:00100000:2.0:1787378348.960121:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604633984 00000100:00100000:2.0:1787378348.960177:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:2.0:1787378348.960187:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13868:x1874201604633984:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787378348.960437:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13868:x1874201604633984:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 251us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378348.960447:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:2.0:1787378348.965042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378348.965145:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604634112 00000100:00100000:0.0:1787378348.965155:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604634112 00000100:00100000:0.0:1787378348.965207:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:0.0:1787378348.965216:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13868:x1874201604634112:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787378348.965492:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13868:x1874201604634112:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 276us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378348.965501:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:1.0:1787378349.007370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378349.007476:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604634240 00000100:00100000:2.0:1787378349.007494:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604634240 00000100:00100000:2.0:1787378349.007548:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787378349.007557:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1874201604634240:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787378349.007599:0:14228:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e041587a-af59-45ee-bb79-c6ec38cf8b37@192.168.203.22@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1787378349.007633:0:14228:0:(genops.c:1406:class_connect()) connect: client e041587a-af59-45ee-bb79-c6ec38cf8b37, cookie 0xdd3c5462d7854046 00000004:00100000:2.0:1787378349.007664:0:14228:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787378349.007805:0:14228:0:(import.c:65:import_set_state_nolock()) ffff9eebbf741800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787378349.007876:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2352:x1874201604634240:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 319us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378349.007884:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1787378349.015249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378349.015290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378349.015376:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604634496 00000100:00100000:0.0:1787378349.015386:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604634496 00000100:00100000:0.0:1787378349.015460:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604634368 00000100:00100000:0.0:1787378349.015463:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604634368 00000100:00100000:0.0:1787378349.015479:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1787378349.015487:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+7:13859:x1874201604634496:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787378349.015529:0:14229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787378349.015591:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+7:13859:x1874201604634496:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 104us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378349.015598:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1787378349.015615:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787378349.015633:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:0:x1874201604634368:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787378349.015644:0:14229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787378349.015666:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:0:x1874201604634368:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 34us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378349.015672:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787378349.017507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378349.017662:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604634624 00000100:00100000:1.0:1787378349.017670:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604634624 00000100:00100000:1.0:1787378349.017759:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1787378349.017768:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:13859:x1874201604634624:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787378349.017834:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:13859:x1874201604634624:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 67us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378349.017843:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00080000:2.0:1787378349.018858:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378349.019870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378349.019906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378349.019973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378349.020021:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604634752 00000100:00100000:1.0:1787378349.020029:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604634752 00000100:00100000:1.0:1787378349.020059:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604634880 00000100:00100000:1.0:1787378349.020062:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604634880 00000100:00100000:1.0:1787378349.020075:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1787378349.020096:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874201604634752:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787378349.020126:0:14866:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e041587a-af59-45ee-bb79-c6ec38cf8b37@192.168.203.22@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:1.0:1787378349.020169:0:14866:0:(genops.c:1406:class_connect()) connect: client e041587a-af59-45ee-bb79-c6ec38cf8b37, cookie 0xdd3c5462d785404d 00002000:00100000:1.0:1787378349.020181:0:14866:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e041587a-af59-45ee-bb79-c6ec38cf8b37/ffff9eeb86307000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787378349.020192:0:14866:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787378349.020437:0:14866:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787378349.020466:0:14866:0:(import.c:65:import_set_state_nolock()) ffff9eeb86300800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787378349.020538:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2352:x1874201604634752:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 441us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378349.020546:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1787378349.020570:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:1.0:1787378349.020576:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874201604634880:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787378349.020591:0:14866:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e041587a-af59-45ee-bb79-c6ec38cf8b37@192.168.203.22@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:1.0:1787378349.020606:0:14866:0:(genops.c:1406:class_connect()) connect: client e041587a-af59-45ee-bb79-c6ec38cf8b37, cookie 0xdd3c5462d7854054 00002000:00100000:1.0:1787378349.020611:0:14866:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e041587a-af59-45ee-bb79-c6ec38cf8b37/ffff9eeb86300000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113675 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787378349.020618:0:14866:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787378349.020777:0:14866:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787378349.020792:0:14866:0:(import.c:65:import_set_state_nolock()) ffff9eeb900ec800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787378349.020815:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2352:x1874201604634880:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 238us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378349.020821:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1787378349.022243:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604635008 00000100:00100000:3.0:1787378349.022254:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604635008 00000100:00100000:3.0:1787378349.022308:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:3.0:1787378349.022317:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:13859:x1874201604635008:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787378349.022530:0:14232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787378349.022685:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:13859:x1874201604635008:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 368us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378349.022693:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00010000:00010000:2.0:1787378349.082327:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378349.204810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378349.204898:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604635136 00000100:00100000:3.0:1787378349.204907:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604635136 00000100:00100000:3.0:1787378349.204964:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1787378349.204974:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:13889:x1874201604635136:12345-192.168.203.22@tcp:101:mkdir.0 00010000:00010000:3.0:1787378349.205006:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378349.205039:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13200/0xdd3c5462d785405b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a729c expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378349.205105:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378349.205118:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378349.205128:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378349.205324:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787378349.205329:0:14230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378349.205404:0:14230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378349.205431:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13200/0xdd3c5462d785405b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 8 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378349.205448:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378349.205457:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb916d9b00) 00010000:00010000:3.0:1787378349.205460:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378349.205464:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e12200, rc 0) 00000100:00100000:3.0:1787378349.205832:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+7:13889:x1874201604635136:12345-192.168.203.22@tcp:101:mkdir.0 Request processed in 859us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378349.205842:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000040:00080000:3.0:1787378349.787811:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787378350.110765:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787378351.130042:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787378351.731747:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 00d50ef6-d535-4a72-b1e6-41488fdde5e5 00000001:00100000:1.0:1787378351.732067:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e041587a-af59-45ee-bb79-c6ec38cf8b37 00010000:00010000:2.0:1787378352.153907:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378352.154146:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626646400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787378352.154222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378352.154816:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3314:1874201626646272:0@lo:400:kworker.0 00000100:00100000:0.0:1787378352.154848:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626646528:0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.154853:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378352.154877:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378352.154885:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626646912:0@lo:400:kworker.0 00000100:00100000:0.0:1787378352.154894:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787378352.154899:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626646656:0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.154906:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378352.154920:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626646784:0@lo:400:kworker.0 00000100:00100000:2.0:1787378352.155108:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626646400 00000100:00100000:2.0:1787378352.155117:0:14868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626646400 00000100:00100000:2.0:1787378352.156168:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787378352.156182:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626646400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787378352.156226:0:14868:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378352.159120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787378352.160396:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787378352.160485:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626646400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4303us (6258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378352.160499:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787378352.160560:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787378352.160588:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626646400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378352.161559:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626646272 00000100:00100000:1.0:1787378352.161568:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626646272 00000100:00100000:1.0:1787378352.161614:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787378352.161623:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3314:x1874201626646272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.161686:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3314:x1874201626646272:12345-0@lo:400:kworker.0 Request processed in 64us (6831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378352.161693:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787378352.161750:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626646528 00000100:00100000:1.0:1787378352.161754:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626646528 00000100:00100000:1.0:1787378352.161794:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787378352.161801:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626646528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.161838:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626646528:12345-0@lo:400:kworker.0 Request processed in 38us (6960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378352.161844:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787378352.161865:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626646912 00000100:00100000:1.0:1787378352.161870:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626646912 00000100:00100000:1.0:1787378352.161897:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626646784 00000100:00100000:1.0:1787378352.161900:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626646784 00000100:00100000:1.0:1787378352.161919:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787378352.161926:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626646912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.161955:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874201626646912:12345-0@lo:400:kworker.0 Request processed in 30us (7048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378352.161962:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787378352.161984:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787378352.161991:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626646784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.162032:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874201626646784:12345-0@lo:400:kworker.0 Request processed in 42us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378352.162038:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787378352.162082:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787378352.162087:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378352.162112:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874201626646912:0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.162123:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3314:1874201626646272:0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.162159:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874201626646784:0@lo:400:kworker.0 00000100:00100000:3.0:1787378352.165979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378352.166124:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626646528:0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.166153:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626646656 00000100:00100000:1.0:1787378352.166160:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626646656 00000100:00100000:1.0:1787378352.166221:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378352.166230:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbb720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626646656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378352.166306:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbb720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874201626646656:12345-0@lo:400:kworker.0 Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378352.166312:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787378352.166349:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebad2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874201626646656:0@lo:400:kworker.0 00000001:02000400:1.0:1787378352.192696:0:16094:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787378352.215912:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e041587a-af59-45ee-bb79-c6ec38cf8b37 00000100:00100000:1.0:1787378352.666293:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626647040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378352.666364:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378352.666486:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626647040 00000100:00100000:2.0:1787378352.666495:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626647040 00000100:00100000:2.0:1787378352.666544:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787378352.666552:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626647040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787378352.666607:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378352.671412:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626647040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4848us (5035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378352.671429:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787378352.673431:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626647040:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787378353.179513:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787378353.258178:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e041587a-af59-45ee-bb79-c6ec38cf8b37 00010000:00010000:2.0:1787378354.202249:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787378354.313622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378354.314084:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378354.314107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378354.314133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378354.314170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378354.314204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378354.321925:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604635648 00000100:00100000:1.0:1787378354.321938:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604635648 00000100:00100000:1.0:1787378354.322011:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604635904 00000100:00100000:1.0:1787378354.322015:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604635904 00000100:00100000:1.0:1787378354.322028:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604635520 00000100:00100000:1.0:1787378354.322031:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604635520 00000100:00100000:1.0:1787378354.322050:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787378354.322060:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2353:x1874201604635648:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378354.322146:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2353:x1874201604635648:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 86us (8063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378354.322155:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787378354.322179:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787378354.322198:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2353:x1874201604635904:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378354.322223:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2353:x1874201604635904:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 37us (8115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378354.322229:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787378354.322242:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787378354.322249:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2353:x1874201604635520:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378354.322270:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2353:x1874201604635520:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (8100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378354.322276:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00080000:3.0:1787378354.322458:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787378354.322463:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787378354.323036:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604635264 00000100:00100000:3.0:1787378354.323043:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604635264 00000100:00100000:3.0:1787378354.323094:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:3.0:1787378354.323102:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb905f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:2353:x1874201604635264:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378354.323147:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb905f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:2353:x1874201604635264:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 45us (9012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378354.323153:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:2.0:1787378354.324092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378354.324231:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604636032 00000100:00100000:3.0:1787378354.324240:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604636032 00000100:00100000:3.0:1787378354.324305:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787378354.324314:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2353:x1874201604636032:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378354.324369:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2353:x1874201604636032:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378354.324374:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00080000:2.0:1787378354.326747:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787378354.328413:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604635776 00000100:00100000:0.0:1787378354.328413:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604635392 00000100:00100000:1.0:1787378354.328427:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604635776 00000100:00100000:0.0:1787378354.328427:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604635392 00000100:00080000:2.0:1787378354.328536:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787378354.328549:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1787378354.328562:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2353:x1874201604635392:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378354.328656:0:14228:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787378354.328658:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2353:x1874201604635392:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (15044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378354.328666:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787378354.328677:0:14228:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787378354.328684:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1787378354.328690:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2353:x1874201604635776:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378354.328715:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2353:x1874201604635776:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (14512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378354.328756:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00080000:2.0:1787378354.329467:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787378355.225820:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787378355.846053:0:16243:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd60b3f110 00000020:00000080:0.0:1787378355.846067:0:16243:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787378355.846072:0:16243:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787378355.846079:0:16243:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd60b413a0 20000000:00000080:0.0:1787378355.846085:0:16243:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eebbbf1fc00 uarg=0000000000000000 20000000:01000000:0.0:1787378355.846122:0:16243:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787378355.846128:0:16243:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787378355.846133:0:16243:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787378355.847189:0:16244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787378355.847333:0:16243:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787378355.856595:0:16243:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787378355.856865:0:16243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.856903:0:16243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 18 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.856910:0:16243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.856917:0:16243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 18 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.856927:0:16243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.856934:0:16243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.856940:0:16243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.856986:0:16243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.856999:0:16243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 12 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378355.857014:0:16243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647168:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378355.857172:0:16243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.857199:0:16243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 12 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378355.857215:0:16243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647296:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378355.857253:0:16243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 18 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.857261:0:16243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 18 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378355.857270:0:16243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647424:0@lo:104: 00000100:00100000:1.0:1787378355.857310:0:16243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787378355.857354:0:16243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.857364:0:16243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 18 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378355.857371:0:16243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647552:0@lo:104: 00000100:00100000:1.0:1787378355.857406:0:16243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378355.857804:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626647424 00000100:00100000:0.0:1787378355.857811:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626647424 00000100:00100000:0.0:1787378355.857858:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626647552 00000100:00100000:0.0:1787378355.857861:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626647552 00000100:00100000:0.0:1787378355.857875:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787378355.857883:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+4:16243:x1874201626647424:12345-0@lo:104: 00010000:00010000:0.0:1787378355.857896:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.857948:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787378355.857955:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+4:16243:x1874201626647424:12345-0@lo:104: Request processed in 72us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378355.857962:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787378355.857979:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378355.857985:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:16243:x1874201626647552:12345-0@lo:104: 00010000:00010000:0.0:1787378355.857993:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.858035:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787378355.858040:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:16243:x1874201626647552:12345-0@lo:104: Request processed in 56us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378355.858047:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787378355.858068:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787378355.858073:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.858080:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb81485400 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:0.0:1787378355.858083:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.858091:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787378355.858097:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378355.858103:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787378355.858129:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.858136:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787378355.858788:0:16243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 18 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378355.858802:0:16243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 18 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378355.858814:0:16243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647808:0@lo:104: 00000100:00100000:1.0:1787378355.858852:0:16243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378355.858885:0:16243:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787378355.858905:0:16243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647424:0@lo:104: 00000100:00100000:1.0:1787378355.858914:0:16243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647552:0@lo:104: 00010000:00010000:0.0:1787378355.859000:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859009:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb81485400/0xdd3c5462d7853ee1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853ee8 expref: -99 pid: 15535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859031:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378355.859035:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859041:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128ac00 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:0.0:1787378355.859044:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859052:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787378355.859058:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378355.859063:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787378355.859083:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859090:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787378355.859106:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859112:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d7853da6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853dad expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859121:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378355.859123:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378355.859124:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378355.859131:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378355.859235:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787378355.859247:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3311:1874201626647680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787378355.859276:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378355.859307:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626647936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787378355.859326:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378355.859354:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626647680 00000100:00100000:0.0:1787378355.859359:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626647680 00010000:00010000:0.0:1787378355.859381:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 19 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378355.859539:0:14211:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787378355.859551:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626647808 00000100:00100000:2.0:1787378355.859555:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626647808 00000100:00100000:2.0:1787378355.859585:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787378355.859593:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad248050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:16243:x1874201626647808:12345-0@lo:104: 00010000:00010000:2.0:1787378355.859602:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378355.859645:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787378355.859651:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad248050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+3:16243:x1874201626647808:12345-0@lo:104: Request processed in 60us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378355.859659:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787378355.859777:0:16243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647808:0@lo:104: 00000100:00100000:0.0:1787378355.859910:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626647936 00000100:00100000:0.0:1787378355.859913:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626647936 00010000:00010000:0.0:1787378355.859928:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 20 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378355.859939:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787378355.859944:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+20:3311:x1874201626647680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378355.859954:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378355.859959:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 20 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859968:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 20 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859984:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128a800/0xdd3c5462d7853ee8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7853ee1 expref: 20 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.859996:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378355.860068:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3311:x1874201626647680:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378355.860085:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787378355.860100:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378355.860106:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:3313:x1874201626647936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378355.860114:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378355.860118:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 18 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860126:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 18 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860136:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9dd04400/0xdd3c5462d7853dad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7853da6 expref: 18 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860155:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378355.860194:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:3313:x1874201626647936:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378355.860200:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787378355.860227:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3313:1874201626647936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378355.860248:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787378355.860252:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860259:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc1dbcc20) 10000000:00010000:0.0:1787378355.860262:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860270:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787378355.860286:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378355.860291:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787378355.860315:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860322:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787378355.860334:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860341:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc1800/0xdd3c5462d7853d59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd3c5462d7853d60 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860355:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378355.860357:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787378355.860359:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378355.860368:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3314:1874201626648064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787378355.860408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378355.860525:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626648064 00000100:00100000:0.0:1787378355.860529:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626648064 00010000:00010000:0.0:1787378355.860542:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 17 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378355.860558:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787378355.860564:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:3314:x1874201626648064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378355.860571:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378355.860575:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 17 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860590:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 17 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860600:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebbf641600/0xdd3c5462d7853d60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd3c5462d7853d59 expref: 17 pid: 14223 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.860609:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378355.860949:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:3314:x1874201626648064:12345-0@lo:103:ldlm_bl.0 Request processed in 384us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378355.860956:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787378355.861007:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3314:1874201626648064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787378355.863764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378355.863797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378355.863845:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604636288 00000100:00100000:0.0:1787378355.863853:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604636288 00010000:00010000:0.0:1787378355.863887:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 13 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378355.863914:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604636160 00000100:00100000:0.0:1787378355.863916:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604636160 00010000:00010000:0.0:1787378355.863925:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 14 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378355.863937:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1787378355.863944:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+14:2354:x1874201604636288:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378355.863956:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378355.863960:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 14 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.863987:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 14 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864005:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378355.864050:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+14:2354:x1874201604636288:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378355.864058:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1787378355.864075:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1787378355.864081:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:2354:x1874201604636160:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378355.864088:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378355.864092:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 13 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864100:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 13 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864112:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864120:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864135:0:14214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864142:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864167:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864190:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864197:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf641e00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378355.864201:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864210:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864220:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378355.864231:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378355.864250:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:2354:x1874201604636160:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 168us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378355.864256:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00010000:00010000:2.0:1787378355.864432:0:16243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eeb9128b800/0xdd3c5462d785403f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7272 expref: 12 pid: 14220 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378355.864453:0:16243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647168:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378355.864467:0:16243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebbf641200/0xdd3c5462d7854007 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7210 expref: 11 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378355.864476:0:16243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16243:1874201626647296:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378355.864508:0:16243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378355.864517:0:16243:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378355.864523:0:16243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378355.864529:0:16243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eebbf641e00/0xdd3c5462d7854069 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378355.867847:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a23aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3311:1874201626647680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787378356.251734:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378356.990864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378356.990906:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604636416 00000100:00100000:3.0:1787378356.990928:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604636416 00000100:00100000:3.0:1787378356.990979:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:3.0:1787378356.990989:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+11:13741:x1874201604636416:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378356.991006:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378356.991026:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eea82e13c00/0xdd3c5462d7854070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72a3 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378356.991056:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eea82e13c00/0xdd3c5462d7854070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72a3 expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378356.991068:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eea82e13c00/0xdd3c5462d7854070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72a3 expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378356.991077:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e13c00, rc 0) 00000100:00100000:3.0:1787378356.991126:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13741:x1874201604636416:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 139us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378356.991134:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:3.0:1787378356.995241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378356.998290:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604636544 00000100:00100000:2.0:1787378356.998304:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604636544 00000100:00100000:2.0:1787378356.998368:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:2.0:1787378356.998378:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13741:x1874201604636544:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378356.998646:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13741:x1874201604636544:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 268us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378356.998654:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:2.0:1787378357.004798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378357.004867:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604636672 00000100:00100000:3.0:1787378357.004878:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604636672 00000100:00100000:3.0:1787378357.004934:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:3.0:1787378357.004944:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13741:x1874201604636672:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.005193:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13741:x1874201604636672:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 249us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.005202:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:2.0:1787378357.010663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378357.010709:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604636800 00000100:00100000:2.0:1787378357.010739:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604636800 00000100:00100000:2.0:1787378357.010794:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:2.0:1787378357.010802:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+12:13741:x1874201604636800:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378357.010820:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378357.010840:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eeb82bc0c00/0xdd3c5462d7854077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72aa expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378357.010870:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eeb82bc0c00/0xdd3c5462d7854077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72aa expref: 13 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378357.010880:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eeb82bc0c00/0xdd3c5462d7854077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72aa expref: 13 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378357.010888:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc0c00, rc 0) 00000100:00100000:2.0:1787378357.010937:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13741:x1874201604636800:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 135us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378357.010944:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:3.0:1787378357.018564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378357.022543:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604636928 00000100:00100000:2.0:1787378357.022558:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604636928 00000100:00100000:3.0:1787378357.025033:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:3.0:1787378357.025058:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13741:x1874201604636928:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.025355:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13741:x1874201604636928:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 299us (6800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.025364:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:2.0:1787378357.030258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378357.030317:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604637056 00000100:00100000:3.0:1787378357.030327:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604637056 00000100:00100000:3.0:1787378357.030404:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:3.0:1787378357.030414:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13741:x1874201604637056:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.030654:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:13741:x1874201604637056:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 240us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.030662:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:2.0:1787378357.274858:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626648192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787378357.274936:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378357.275016:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626648192 00000100:00100000:2.0:1787378357.275024:0:14868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626648192 00000100:00100000:2.0:1787378357.275082:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787378357.275090:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626648192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787378357.275134:0:14868:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787378357.275202:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874201626648192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378357.275210:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787378357.275234:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787378357.275248:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874201626648192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787378357.280228:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378357.285864:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626648576:0@lo:400:kworker.0 00000100:00100000:3.0:1787378357.285881:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626648704:0@lo:400:kworker.0 00000100:00100000:1.0:1787378357.285955:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3312:1874201626648320:0@lo:400:kworker.0 00000100:00100000:3.0:1787378357.286026:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378357.286085:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebbb723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626648448:0@lo:400:kworker.0 00000100:00100000:2.0:1787378357.286291:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626648704 00000100:00100000:2.0:1787378357.286299:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626648704 00000100:00100000:2.0:1787378357.286352:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787378357.286362:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626648704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378357.286516:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378357.286554:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874201626648704:12345-0@lo:400:kworker.0 Request processed in 193us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378357.286562:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787378357.286584:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787378357.286963:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874201626648704:0@lo:400:kworker.0 00000100:00100000:3.0:1787378357.286986:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626648448 00000100:00100000:3.0:1787378357.286989:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626648448 00000100:00100000:3.0:1787378357.287060:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787378357.287066:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626648448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378357.287099:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626648448:12345-0@lo:400:kworker.0 Request processed in 34us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.287105:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787378357.287142:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626648448:0@lo:400:kworker.0 00000100:00080000:2.0:1787378357.287987:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378357.288710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378357.289234:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626648320 00000100:00100000:3.0:1787378357.289242:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626648320 00000100:00100000:3.0:1787378357.289289:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787378357.289298:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:3312:x1874201626648320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378357.289354:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:3312:x1874201626648320:12345-0@lo:400:kworker.0 Request processed in 57us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.289360:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787378357.289407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378357.289949:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebbb721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3312:1874201626648320:0@lo:400:kworker.0 00000100:00100000:1.0:1787378357.289962:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874201626648832:0@lo:400:kworker.0 00000100:00100000:3.0:1787378357.290096:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626648576 00000100:00100000:3.0:1787378357.290102:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626648576 00000100:00100000:3.0:1787378357.290224:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787378357.290232:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626648576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378357.290887:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874201626648576:12345-0@lo:400:kworker.0 Request processed in 652us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.290896:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787378357.290942:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874201626648576:0@lo:400:kworker.0 00000100:00100000:1.0:1787378357.291481:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378357.292379:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626648832 00000100:00100000:2.0:1787378357.292389:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626648832 00000100:00100000:2.0:1787378357.292456:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787378357.292465:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874201626648832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378357.292529:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874201626648832:12345-0@lo:400:kworker.0 Request processed in 65us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378357.292536:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787378357.292555:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378357.294115:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874201626648832:0@lo:400:kworker.0 10000000:01000000:2.0:1787378357.596105:0:14225:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787378357.596112:0:14225:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebb8d39000 from 10 10000000:01000000:2.0:1787378357.596117:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787378357.596179:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0000/0xdd3c5462d785407e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378357.596192:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0000/0xdd3c5462d785407e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378357.596219:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0000/0xdd3c5462d785407e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378357.596247:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626648960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.596321:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378357.596379:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626648960 00000100:00100000:2.0:1787378357.596380:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914480 going to sleep for 11 seconds 00000100:00100000:3.0:1787378357.596387:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626648960 00000100:00100000:3.0:1787378357.596446:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787378357.596455:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+16:14225:x1874201626648960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378357.596468:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378357.596481:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eea82e13200/0xdd3c5462d7854085 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d785407e expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.596504:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eea82e13200/0xdd3c5462d7854085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d785407e expref: 17 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.596514:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eea82e13200/0xdd3c5462d7854085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d785407e expref: 17 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.596528:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e13200, rc 0) 00000100:00100000:3.0:1787378357.596585:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:14225:x1874201626648960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.596592:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787378357.597012:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626648960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378357.597027:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0000/0xdd3c5462d785407e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7854085 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378357.597037:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0000/0xdd3c5462d785407e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7854085 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378357.597100:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.597130:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378357.597160:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914480 going to sleep for 11 seconds 00000100:00100000:3.0:1787378357.597193:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626649088 00000100:00100000:3.0:1787378357.597198:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626649088 00000100:00100000:3.0:1787378357.597232:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787378357.597239:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:14225:x1874201626649088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.597518:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:14225:x1874201626649088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.597525:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787378357.601994:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.602065:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.602138:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378357.602198:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914480 going to sleep for 11 seconds 00000100:00100000:3.0:1787378357.602300:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626649216 00000100:00100000:3.0:1787378357.602308:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626649216 00000100:00100000:3.0:1787378357.602364:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787378357.602373:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:14225:x1874201626649216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787378357.603315:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:14225:x1874201626649216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 936us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378357.603328:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787378357.603417:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787378357.604319:0:16307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787378357.604474:0:14225:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787378357.604495:0:14225:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787378357.604506:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0000/0xdd3c5462d785407e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7854085 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378357.604524:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb82bc0000/0xdd3c5462d785407e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7854085 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787378357.604535:0:14225:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787378357.604538:0:14225:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eeb88272800 from 10 10000000:01000000:0.0:1787378357.604540:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787378357.604574:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d785408c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378357.604582:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d785408c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378357.604592:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d785408c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378357.604613:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb9a238380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787378357.604661:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378357.604700:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8939b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787378357.604755:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626649344 00000100:00100000:3.0:1787378357.604761:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626649344 00000100:00100000:3.0:1787378357.604807:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787378357.604816:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+17:14225:x1874201626649344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378357.604829:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378357.604841:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eea82e13e00/0xdd3c5462d7854093 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d785408c expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.604865:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eea82e13e00/0xdd3c5462d7854093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d785408c expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.604885:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eea82e13e00/0xdd3c5462d7854093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d785408c expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.604893:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e13e00, rc 0) 00000100:00100000:3.0:1787378357.604931:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:14225:x1874201626649344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.604937:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787378357.605060:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb9a238380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378357.605074:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d785408c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7854093 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.605082:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d785408c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d7854093 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378357.605132:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.605157:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378357.605189:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574000 going to sleep for 11 seconds 00000100:00100000:0.0:1787378357.605821:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626649472 00000100:00100000:0.0:1787378357.605827:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626649472 00000100:00100000:0.0:1787378357.605858:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787378357.605865:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:14225:x1874201626649472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787378357.606136:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:14225:x1874201626649472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378357.606144:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787378357.608626:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.608687:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.608793:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378357.608826:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574000 going to sleep for 11 seconds 00000100:00100000:3.0:1787378357.608847:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626649600 00000100:00100000:3.0:1787378357.608852:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626649600 00000100:00100000:3.0:1787378357.608893:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787378357.608901:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae92d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:14225:x1874201626649600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.609218:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae92d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:14225:x1874201626649600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.609226:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787378357.609275:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787378357.610679:0:16308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787378357.610778:0:14225:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787378357.610797:0:14225:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787378357.610809:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d785408c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7854093 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.610821:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eeb9128ac00/0xdd3c5462d785408c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d7854093 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787378357.610830:0:14225:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787378357.610834:0:14225:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9eebbc37f000 from 10 10000000:01000000:3.0:1787378357.610836:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787378357.610868:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eea82e13600/0xdd3c5462d785409a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.610877:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9eea82e13600/0xdd3c5462d785409a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.610887:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9eea82e13600/0xdd3c5462d785409a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378357.610907:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787378357.610953:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787378357.611112:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb9e0923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787378357.611141:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626649728 00000100:00100000:3.0:1787378357.611147:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626649728 00000100:00100000:3.0:1787378357.611195:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787378357.611203:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+18:14225:x1874201626649728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787378357.611214:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378357.611226:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eea82e13400/0xdd3c5462d78540a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd3c5462d785409a expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.611249:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eea82e13400/0xdd3c5462d78540a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd3c5462d785409a expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.611258:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eea82e13400/0xdd3c5462d78540a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd3c5462d785409a expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378357.611266:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e13400, rc 0) 00000100:00100000:3.0:1787378357.611349:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:14225:x1874201626649728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378357.611356:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787378357.611442:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787378357.611456:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9eea82e13600/0xdd3c5462d785409a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78540a1 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378357.611472:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9eea82e13600/0xdd3c5462d785409a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd3c5462d78540a1 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378357.611523:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.611550:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378357.611568:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914600 going to sleep for 11 seconds 00000100:00100000:2.0:1787378357.611581:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626649856 00000100:00100000:2.0:1787378357.611584:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626649856 00000100:00100000:2.0:1787378357.611604:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787378357.611610:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:14225:x1874201626649856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.611841:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:14225:x1874201626649856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378357.611848:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787378357.611874:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.611901:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.611934:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378357.611950:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb89914600 going to sleep for 11 seconds 00000100:00100000:2.0:1787378357.611961:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626649984 00000100:00100000:2.0:1787378357.611964:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626649984 00000100:00100000:2.0:1787378357.611985:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787378357.611991:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:14225:x1874201626649984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787378357.612115:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:14225:x1874201626649984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378357.612122:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787378357.612173:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606b5901-a2d8-4f42-a60c-6eb8ab84a876:14225:1874201626649984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787378357.616124:0:16309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787378357.618213:0:14225:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787378357.618254:0:14225:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787378357.618266:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9eea82e13600/0xdd3c5462d785409a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78540a1 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378357.618291:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9eea82e13600/0xdd3c5462d785409a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd3c5462d78540a1 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378357.786352:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787378357.787904:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626650112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378357.789103:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378357.789276:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626650112 00000100:00100000:0.0:1787378357.789285:0:14868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626650112 00000100:00100000:0.0:1787378357.789339:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787378357.789348:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626650112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378357.789385:0:14868:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787378357.789456:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626650112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378357.789464:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787378357.789664:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626650112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787378358.304430:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787378359.002704:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787378359.324708:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378359.422168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378359.422212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378359.422244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378359.422279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378359.422302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378359.422316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378359.422336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378359.422361:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604637440 00000100:00100000:0.0:1787378359.422370:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604637440 00000100:00100000:2.0:1787378359.422505:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604637184 00000100:00100000:2.0:1787378359.422510:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604637184 00000100:00100000:2.0:1787378359.422545:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:2.0:1787378359.422554:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:2355:x1874201604637184:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378359.422621:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:2355:x1874201604637184:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 67us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378359.422628:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:2.0:1787378359.422661:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604637696 00000100:00100000:2.0:1787378359.422665:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604637696 00000100:00100000:2.0:1787378359.422690:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604637312 00000100:00100000:2.0:1787378359.422693:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604637312 00000100:00100000:2.0:1787378359.422712:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1787378359.422757:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2355:x1874201604637696:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378359.422793:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2355:x1874201604637696:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 74us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378359.422800:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1787378359.422814:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1787378359.422822:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2355:x1874201604637312:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378359.422847:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2355:x1874201604637312:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378359.422852:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00080000:2.0:1787378359.422869:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787378359.422874:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378359.423008:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604637952 00000100:00100000:2.0:1787378359.423025:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604637952 00000100:00100000:3.0:1787378359.423087:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604637568 00000100:00100000:3.0:1787378359.423092:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604637568 00000100:00100000:0.0:1787378359.423158:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604637824 00000100:00100000:0.0:1787378359.423162:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604637824 00000100:00100000:2.0:1787378359.423490:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787378359.423499:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2355:x1874201604637440:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378359.423585:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2355:x1874201604637440:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 88us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378359.423592:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787378359.423606:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787378359.423613:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2355:x1874201604637952:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378359.423640:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2355:x1874201604637952:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378359.423645:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00080000:2.0:1787378359.423659:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787378359.423663:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787378359.426740:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1787378359.426762:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2355:x1874201604637568:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787378359.426836:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2355:x1874201604637568:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (4518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378359.426844:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787378359.427383:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1787378359.427394:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2355:x1874201604637824:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787378359.435318:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2355:x1874201604637824:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 7916us (12969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378359.435351:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:2.0:1787378360.202200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378360.202292:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604638080 00000100:00100000:0.0:1787378360.202302:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604638080 00000100:00100000:0.0:1787378360.202366:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1787378360.202386:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:14400:x1874201604638080:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378360.202417:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378360.202441:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78540a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72b1 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.202512:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.202527:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.202541:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.202556:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.202564:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.202570:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203086:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78540bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203108:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78540bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203116:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78540bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378360.203230:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787378360.203235:0:14230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787378360.203331:0:14230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78540bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203343:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203350:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203356:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203362:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378360.203366:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203373:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203385:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb916d9b00) 00010000:00010000:0.0:1787378360.203387:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378360.203391:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203406:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b000/0xdd3c5462d78540af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203417:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203423:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203429:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203434:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378360.203437:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203442:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203449:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9eeb829cda00) 00010000:00010000:0.0:1787378360.203451:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378360.203453:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203458:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78540b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203487:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d78540a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72b1 expref: 8 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203510:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a000/0xdd3c5462d78540bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72b1 expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.203517:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:0.0:1787378360.203519:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787378360.203522:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a000, rc 0) 00000100:00100000:0.0:1787378360.205809:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:14400:x1874201604638080:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 3414us (3608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378360.205823:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787378360.221257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.221433:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604638336 00000100:00100000:1.0:1787378360.221444:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604638336 00000100:00100000:1.0:1787378360.221510:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787378360.221521:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:14400:x1874201604638336:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378360.221546:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378360.221571:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d78540c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72b8 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.221654:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.221688:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.221701:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.221776:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.221785:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.221791:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.223017:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641200/0xdd3c5462d78540d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.223033:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641200/0xdd3c5462d78540d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.223042:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641200/0xdd3c5462d78540d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378360.223053:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787378360.225234:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225251:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225258:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225274:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378360.225279:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225286:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225304:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eeb829cdb00) 00010000:00010000:1.0:1787378360.225307:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378360.225312:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225318:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225333:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225339:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225345:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225350:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378360.225353:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225358:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225377:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eeb85524700) 00010000:00010000:1.0:1787378360.225380:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378360.225383:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.225389:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.229708:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d78540c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72b8 expref: 10 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.229756:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641200/0xdd3c5462d78540d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72b8 expref: 9 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.229766:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb85524300) 00010000:00010000:1.0:1787378360.229769:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378360.229773:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641200, rc 0) 00000100:00100000:1.0:1787378360.229851:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14400:x1874201604638336:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 8331us (8602us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787378360.229861:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787378360.237188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378360.237411:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604638464 00000100:00100000:2.0:1787378360.237424:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604638464 00000100:00100000:2.0:1787378360.237494:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1787378360.237504:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14400:x1874201604638464:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787378360.237625:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14400:x1874201604638464:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 122us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378360.237632:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1787378360.283415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.283554:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604638592 00000100:00100000:1.0:1787378360.283566:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604638592 00000100:00100000:1.0:1787378360.283626:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1787378360.283636:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14406:x1874201604638592:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378360.283658:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378360.283679:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d78540e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72bf expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.283797:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.283812:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.283823:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.283836:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.283841:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.283847:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284114:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284133:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284139:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284153:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378360.284157:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284174:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284187:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb916d9b00) 00010000:00010000:1.0:1787378360.284191:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378360.284195:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284202:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d78540ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284216:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284221:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284227:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284232:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378360.284234:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284240:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284247:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eeb85524700) 00010000:00010000:1.0:1787378360.284251:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378360.284254:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284270:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d78540f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284304:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d78540e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72bf expref: 10 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284315:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb916d9b00) 00010000:00010000:1.0:1787378360.284317:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378360.284321:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d78540e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72bf expref: 10 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.284331:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf641600, rc 0) 00000100:00100000:1.0:1787378360.284409:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14406:x1874201604638592:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 765us (1004us total) trans 0 rc 301/301 00000100:00100000:1.0:1787378360.284417:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1787378360.297958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378360.298097:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604638720 00000100:00100000:3.0:1787378360.298118:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604638720 00000100:00100000:3.0:1787378360.298180:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:3.0:1787378360.298189:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14406:x1874201604638720:12345-192.168.203.22@tcp:700:lfs.0 00000100:00100000:3.0:1787378360.298278:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14406:x1874201604638720:12345-192.168.203.22@tcp:700:lfs.0 Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378360.298286:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:3.0:1787378360.303369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378360.305302:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604638976 00000100:00100000:2.0:1787378360.305319:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604638976 00000100:00100000:2.0:1787378360.305465:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787378360.305489:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14406:x1874201604638976:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:2.0:1787378360.305546:0:16163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378360.305574:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12c00/0xdd3c5462d785402a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a723a expref: 9 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.305597:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb916d9b00) 00010000:00010000:2.0:1787378360.305602:0:16163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787378360.306274:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.306292:0:16163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 5 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.306301:0:16163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.306335:0:16163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 5 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.306350:0:16163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 5 pid: 14230 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378360.306366:0:16163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867da680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16163:1874201626650240:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787378360.306464:0:16163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb987e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787378360.311987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.313679:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604639104 00000100:00100000:1.0:1787378360.313694:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604639104 00010000:00010000:1.0:1787378360.313774:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 6 pid: 14230 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378360.313825:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787378360.313836:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2353:x1874201604639104:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787378360.313852:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378360.313859:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 6 pid: 14230 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.313892:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 6 pid: 14230 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.313915:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb916d9b00) 00010000:00010000:1.0:1787378360.313921:0:14214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.313932:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.313939:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.313958:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787378360.314021:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2353:x1874201604639104:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 186us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378360.314028:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00010000:00010000:2.0:1787378360.316575:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d7854062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a729c expref: 5 pid: 14230 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378360.316601:0:16163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867da680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16163:1874201626650240:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787378360.317313:0:16163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.317326:0:16163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.317332:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.317358:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.317370:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.317380:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378360.318753:0:16163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787378360.318768:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.318776:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.318784:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.318789:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378360.318793:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.318800:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.318824:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb916d9b00) 00010000:00010000:2.0:1787378360.318827:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378360.318831:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.318837:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78540fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378360.318856:0:16163:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a37e7ce reply state 00000000a13bcbb6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378360.318863:0:16163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378360.318950:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+10:14406:x1874201604638976:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 13461us (15588us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787378360.318959:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00010000:00010000:3.0:1787378360.324213:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.324232:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.324240:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.324246:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378360.324250:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.324259:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.324276:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eeb87ea5500) 00010000:00010000:3.0:1787378360.324279:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378360.324283:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.324290:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854103 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.346206:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787378360.404517:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.405668:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604639232 00000100:00100000:1.0:1787378360.405681:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604639232 00000100:00100000:1.0:1787378360.405777:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:1.0:1787378360.405789:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:14414:x1874201604639232:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:1.0:1787378360.405813:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378360.405836:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d785410a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72c6 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.405898:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7854111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.405929:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7854111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.405951:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7854111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378360.406012:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787378360.406016:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378360.406312:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7854111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.406340:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d785410a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72c6 expref: 11 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.406359:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640800/0xdd3c5462d7854111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72c6 expref: 10 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.406367:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524700) 00010000:00010000:1.0:1787378360.406370:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787378360.406374:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf640800, rc 0) 00000100:00100000:1.0:1787378360.406562:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+10:14414:x1874201604639232:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 775us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378360.406570:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1787378360.444885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.444962:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604639360 00000100:00100000:1.0:1787378360.444972:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604639360 00000100:00100000:1.0:1787378360.445037:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1787378360.445047:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:14415:x1874201604639360:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378360.445066:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378360.445094:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d7854118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72cd expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.445170:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d785411f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.445183:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d785411f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.445195:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d785411f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378360.445263:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787378360.445268:0:14230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378360.445297:0:14230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d785411f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.445323:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641600/0xdd3c5462d7854118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72cd expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.445341:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640600/0xdd3c5462d785411f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72cd expref: 6 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.445349:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524700) 00010000:00010000:1.0:1787378360.445353:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787378360.445356:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eebbf640600, rc 0) 00000100:00100000:1.0:1787378360.445431:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:14415:x1874201604639360:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 384us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378360.445438:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1787378360.447950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.448257:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604639488 00000100:00100000:1.0:1787378360.448279:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604639488 00000100:00100000:1.0:1787378360.448342:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1787378360.448352:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:14415:x1874201604639488:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378360.448373:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378360.448404:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641e00/0xdd3c5462d7854126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72d4 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448469:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448482:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448493:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448507:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448515:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448522:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448673:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d785413b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448681:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d785413b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448688:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d785413b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378360.448759:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787378360.448763:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787378360.448783:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d785413b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448795:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448801:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448807:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448812:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378360.448817:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448824:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448836:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524700) 00010000:00010000:1.0:1787378360.448839:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378360.448843:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448849:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640c00/0xdd3c5462d785412d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448862:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448878:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448883:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448888:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eebbf640e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378360.448891:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448897:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448905:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eeb85524c00) 00010000:00010000:1.0:1787378360.448908:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378360.448910:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448916:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf640e00/0xdd3c5462d7854134 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448947:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eebbf641e00/0xdd3c5462d7854126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72d4 expref: 8 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448960:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d785413b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72d4 expref: 7 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.448968:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eeb85524000) 00010000:00010000:1.0:1787378360.448970:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787378360.448981:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd04400, rc 0) 00000100:00100000:1.0:1787378360.449048:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+7:14415:x1874201604639488:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 697us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378360.449056:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1787378360.456117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.461353:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604639744 00000100:00100000:1.0:1787378360.461372:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604639744 00000100:00100000:1.0:1787378360.462981:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1787378360.462995:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+7:14415:x1874201604639744:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787378360.463016:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378360.463038:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72db expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787378360.463164:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787378360.463298:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854142 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72db expref: 9 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.463311:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524700) 00010000:00010000:1.0:1787378360.463314:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787378360.463319:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72db expref: 9 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.463334:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05200, rc 0) 00000100:00100000:1.0:1787378360.465287:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+8:14415:x1874201604639744:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2284us (9171us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787378360.465299:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1787378360.474329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.476732:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604640000 00000100:00100000:1.0:1787378360.476746:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604640000 00000100:00100000:1.0:1787378360.476822:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1787378360.476849:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+8:14415:x1874201604640000:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:1.0:1787378360.476917:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378360.476954:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04400/0xdd3c5462d785413b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72d4 expref: 8 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.476975:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eeb85524000) 00010000:00010000:1.0:1787378360.476985:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787378360.477009:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.477023:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378360.477033:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787378360.477272:0:14228:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045c863c3 reply state 0000000067dd580d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378360.477282:0:14228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787378360.477297:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787378360.477390:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+9:14415:x1874201604640000:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 543us (3071us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787378360.477398:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1787378360.479656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378360.479945:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604640256 00000100:00100000:2.0:1787378360.479955:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604640256 00000100:00100000:2.0:1787378360.480019:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1787378360.480029:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+10:14415:x1874201604640256:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787378360.480751:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+11:14415:x1874201604640256:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 692us (1073us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787378360.480761:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00010000:00010000:3.0:1787378360.482312:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.482327:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.482335:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.482342:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378360.482346:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.482354:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.482369:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eeb85524c00) 00010000:00010000:3.0:1787378360.482372:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787378360.482377:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.482383:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05200/0xdd3c5462d7854150 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378360.485096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378360.485124:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604640512 00000100:00100000:0.0:1787378360.485133:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604640512 00000100:00100000:0.0:1787378360.485191:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787378360.485201:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb9a239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+9:14415:x1874201604640512:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378360.485225:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378360.485252:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7854157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72e2 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485325:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485351:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485362:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485378:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485385:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485392:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378360.485534:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787378360.485640:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485648:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485655:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485661:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378360.485665:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485672:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485694:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524700) 00010000:00010000:0.0:1787378360.485698:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378360.485703:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485709:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d785415e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485937:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485946:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485951:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485956:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128bc00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378360.485958:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485964:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485972:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378360.485974:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378360.485977:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.485982:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128bc00/0xdd3c5462d7854165 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.486080:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7854157 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e2 expref: 11 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.486092:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524700) 00010000:00010000:0.0:1787378360.486094:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378360.486097:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a200/0xdd3c5462d7854157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e2 expref: 11 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.486106:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a200, rc 0) 00000100:00100000:0.0:1787378360.486406:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb9a239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+10:14415:x1874201604640512:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1196us (1304us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787378360.486416:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787378360.489099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378360.489216:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604640640 00000100:00100000:3.0:1787378360.489226:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604640640 00000100:00100000:3.0:1787378360.489291:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1787378360.489301:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+10:14415:x1874201604640640:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787378360.489339:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378360.489363:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854173 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72e9 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.489464:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.489478:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.489489:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378360.489540:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787378360.489544:0:14229:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378360.489570:0:14229:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.489596:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854173 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 12 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.489612:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 11 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.489631:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eeb916d9800) 00010000:00010000:3.0:1787378360.489635:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787378360.489638:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e12400, rc 0) 00000100:00100000:3.0:1787378360.490012:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+11:14415:x1874201604640640:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 711us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378360.490020:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1787378360.494100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378360.494684:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604640768 00000100:00100000:2.0:1787378360.494695:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604640768 00000100:00100000:2.0:1787378360.495540:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1787378360.495557:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+11:14415:x1874201604640768:12345-192.168.203.22@tcp:37:lfs.0 00000100:00100000:2.0:1787378360.507113:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+11:14415:x1874201604640768:12345-192.168.203.22@tcp:37:lfs.0 Request processed in 11549us (13012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378360.508111:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1787378360.516641:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378360.517347:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604641024 00000100:00100000:3.0:1787378360.517358:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604641024 00000100:00100000:3.0:1787378360.517428:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1787378360.517439:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8442e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+11:14415:x1874201604641024:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787378360.517695:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8442e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e041587a-af59-45ee-bb79-c6ec38cf8b37+12:14415:x1874201604641024:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 258us (1063us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787378360.517703:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1787378360.633070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378360.633200:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604641152 00000100:00100000:0.0:1787378360.633210:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604641152 00000100:00100000:0.0:1787378360.633274:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1787378360.633284:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+10:14421:x1874201604641152:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787378360.633304:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378360.633323:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7854181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72f0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633397:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633411:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633438:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633454:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633462:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633469:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633581:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ae00/0xdd3c5462d7854196 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633590:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ae00/0xdd3c5462d7854196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633608:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ae00/0xdd3c5462d7854196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378360.633642:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787378360.633645:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787378360.633685:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ae00/0xdd3c5462d7854196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633697:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633703:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633760:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633771:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378360.633776:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633784:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633796:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524700) 00010000:00010000:0.0:1787378360.633799:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378360.633804:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633810:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d7854188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633824:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633830:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633834:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633839:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378360.633841:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633856:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633863:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378360.633865:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378360.633868:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633873:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d785418f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633903:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a400/0xdd3c5462d7854181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f0 expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633916:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128ae00/0xdd3c5462d7854196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f0 expref: 11 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.633923:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eeb916d9800) 00010000:00010000:0.0:1787378360.633925:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787378360.633928:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128ae00, rc 0) 00000100:00100000:0.0:1787378360.633984:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14421:x1874201604641152:12345-192.168.203.22@tcp:101:bash.0 Request processed in 702us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378360.633992:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1787378360.640433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378360.640522:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604641408 00000100:00100000:3.0:1787378360.640532:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604641408 00000100:00100000:3.0:1787378360.640596:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:3.0:1787378360.640605:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14421:x1874201604641408:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787378360.640624:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378360.640644:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d785419d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72f7 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.640781:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.640795:0:14229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 11 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.640804:0:14229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.640835:0:14229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 11 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.640864:0:14229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 11 pid: 14229 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378360.640878:0:14229:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14229:1874201626650368:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378360.640972:0:14229:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeba8684600 going to sleep for 11 seconds 00000100:00100000:3.0:1787378360.644383:0:14229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14229:1874201626650368:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378360.644430:0:14229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378360.645433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378360.646008:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604641536 00000100:00100000:3.0:1787378360.646017:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604641536 00010000:00010000:3.0:1787378360.646055:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 12 pid: 14229 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378360.646103:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1787378360.646112:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+12:2353:x1874201604641536:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378360.646125:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378360.646132:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 12 pid: 14229 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.646154:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 12 pid: 14229 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.646186:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785417a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72e9 expref: 12 pid: 14229 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.646223:0:14215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eeb916d9800) 00010000:00010000:3.0:1787378360.646228:0:14215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.646238:0:14215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.646246:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.646282:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378360.646337:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+11:2353:x1874201604641536:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 225us (910us total) trans 0 rc 0/0 00010000:00010000:2.0:1787378360.646341:0:14229:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378360.646345:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00010000:00010000:2.0:1787378360.646349:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.646373:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.646382:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.646390:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647067:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647090:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647098:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378360.647113:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787378360.647139:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647156:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647173:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647179:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eea82e13a00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378360.647183:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647190:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647200:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eeb916d9800) 00010000:00010000:2.0:1787378360.647203:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378360.647207:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647213:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d78541a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787378360.647223:0:14229:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c25b4a12 reply state 000000008926123c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378360.647231:0:14229:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787378360.647263:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d785419d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 14 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647275:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 13 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.647282:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378360.647290:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787378360.647293:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1c00, rc 0) 00000100:00100000:2.0:1787378360.647335:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14421:x1874201604641408:12345-192.168.203.22@tcp:101:bash.0 Request processed in 6731us (6912us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787378360.647342:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00010000:00010000:3.0:1787378360.656871:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.656889:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.656898:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.656904:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378360.656911:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.656918:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.656955:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9eeb87ea5100) 00010000:00010000:3.0:1787378360.656958:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378360.656963:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378360.656969:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378360.668881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378360.668990:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604641664 00000100:00100000:2.0:1787378360.669000:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604641664 00000100:00100000:2.0:1787378360.669069:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1787378360.669080:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+13:14421:x1874201604641664:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787378360.669107:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378360.669130:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a72fe expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.669217:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.669231:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.669244:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378360.669287:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787378360.669292:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378360.669310:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.669321:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.669344:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 15 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.669389:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 14 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.669398:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378360.669401:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378360.669405:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1600, rc 0) 00000100:00100000:2.0:1787378360.669467:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14421:x1874201604641664:12345-192.168.203.22@tcp:101:bash.0 Request processed in 388us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378360.669474:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:1.0:1787378360.675671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378360.675815:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604641920 00000100:00100000:3.0:1787378360.675825:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604641920 00000100:00100000:3.0:1787378360.675884:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:3.0:1787378360.676612:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14421:x1874201604641920:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1787378360.677610:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+15:14421:x1874201604641920:12345-192.168.203.22@tcp:35:bash.0 Request processed in 1711us (1940us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787378360.677622:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787378360.760154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378360.760262:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604642176 00000100:00100000:0.0:1787378360.760272:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604642176 00000100:00100000:0.0:1787378360.760358:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1787378360.760368:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+15:14431:x1874201604642176:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787378360.760392:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378360.760411:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d78541ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7305 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787378360.760539:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787378360.760671:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d78541ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7305 expref: 17 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.760687:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eeb85524700) 00010000:00010000:0.0:1787378360.760690:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378360.760695:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b400/0xdd3c5462d78541ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7305 expref: 17 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.760711:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b400, rc 0) 00000100:00100000:0.0:1787378360.760839:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:14431:x1874201604642176:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 471us (703us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787378360.760846:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1787378360.766766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378360.766868:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604642432 00000100:00100000:2.0:1787378360.766877:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604642432 00000100:00100000:2.0:1787378360.766941:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787378360.766952:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:14431:x1874201604642432:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787378360.767410:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+17:14431:x1874201604642432:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 457us (652us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787378360.767419:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787378360.823755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378360.823847:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604642688 00000100:00100000:2.0:1787378360.823856:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604642688 00000100:00100000:2.0:1787378360.823920:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:2.0:1787378360.823931:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+17:14434:x1874201604642688:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787378360.823953:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378360.823974:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a730c expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.824087:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d78541e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.824113:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d78541e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.824137:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d78541e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378360.824160:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787378360.824290:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a730c expref: 20 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.824310:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d78541e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a730c expref: 19 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.824319:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378360.824322:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378360.824326:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1400, rc 0) 00000100:00100000:2.0:1787378360.824455:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+19:14434:x1874201604642688:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 525us (736us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787378360.824463:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:1.0:1787378360.846599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378360.846671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378360.846754:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604642816 00000100:00100000:0.0:1787378360.846765:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604642816 00000100:00100000:0.0:1787378360.846821:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1787378360.846832:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+19:14434:x1874201604642816:12345-192.168.203.22@tcp:54:lfs.0 00000100:00100000:2.0:1787378360.846879:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604642944 00000100:00100000:2.0:1787378360.846885:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604642944 00010000:00010000:0.0:1787378360.846901:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.846919:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.846941:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.846969:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378360.846975:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00010000:00010000:0.0:1787378360.846981:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378360.846989:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+20:2356:x1874201604642944:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378360.846994:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.847002:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b200 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378360.847003:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378360.847006:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.847024:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d78541e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a730c expref: 20 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.847426:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.847440:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:0.0:1787378360.847442:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787378360.847446:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378360.847452:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b200/0xdd3c5462d78541f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378360.847495:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378360.847501:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378360.847766:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+19:14434:x1874201604642816:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 935us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378360.847776:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:2.0:1787378360.847809:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+18:2356:x1874201604642944:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 822us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378360.847817:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1787378360.854515:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378360.854597:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604643200 00000100:00100000:2.0:1787378360.854607:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604643200 00000100:00100000:2.0:1787378360.854714:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1787378360.854754:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+18:14434:x1874201604643200:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787378360.855031:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+19:14434:x1874201604643200:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 280us (525us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787378360.855040:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000040:00080000:1.0:1787378361.050481:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787378361.214715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378361.214829:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604643456 00000100:00100000:2.0:1787378361.214838:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604643456 00000100:00100000:2.0:1787378361.214915:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1787378361.214925:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+19:14465:x1874201604643456:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1787378361.214953:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378361.214970:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d78541f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7313 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.215063:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.215077:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.215106:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378361.215126:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787378361.215269:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d78541f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7313 expref: 22 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.215287:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7313 expref: 21 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.215296:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378361.215299:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787378361.215302:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1800, rc 0) 00000100:00100000:2.0:1787378361.215364:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+21:14465:x1874201604643456:12345-192.168.203.22@tcp:101:cat.0 Request processed in 441us (658us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787378361.215371:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00080000:0.0:1787378361.216081:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787378361.226085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378361.226234:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604643712 00000100:00100000:3.0:1787378361.226245:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604643712 00000100:00100000:3.0:1787378361.226310:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787378361.226321:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+21:14465:x1874201604643712:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:3.0:1787378361.227122:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+22:14465:x1874201604643712:12345-192.168.203.22@tcp:35:cat.0 Request processed in 792us (1038us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787378361.227132:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1787378361.237783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378361.239554:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604643840 00000100:00100000:3.0:1787378361.239568:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604643840 00000100:00100000:3.0:1787378361.239649:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:3.0:1787378361.239658:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+22:2355:x1874201604643840:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378361.239690:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378361.239741:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d78541ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7313 expref: 22 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.239765:0:14215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:3.0:1787378361.239770:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378361.239846:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+21:2355:x1874201604643840:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 189us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378361.239854:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787378361.278033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378361.278184:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604644096 00000100:00100000:3.0:1787378361.278196:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604644096 00000100:00100000:3.0:1787378361.278260:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1787378361.278270:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+21:14471:x1874201604644096:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:3.0:1787378361.278296:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378361.278318:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785420d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a731a expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.278433:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.278446:0:14229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 22 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.278453:0:14229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 22 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.278461:0:14229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.278510:0:14229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 22 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.278523:0:14229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 22 pid: 14228 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378361.278536:0:14229:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14229:1874201626650496:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378361.278643:0:14229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 22 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.278652:0:14229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 22 pid: 14229 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378361.278662:0:14229:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14229:1874201626650624:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378361.278686:0:14229:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebbf574900 going to sleep for 11 seconds 00000100:00100000:0.0:1787378361.281654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378361.281759:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604644224 00000100:00100000:2.0:1787378361.281769:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604644224 00010000:00010000:2.0:1787378361.281812:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 23 pid: 14228 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378361.281855:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787378361.281865:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad37a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+23:2353:x1874201604644224:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378361.281879:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378361.281885:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 23 pid: 14228 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.281919:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 23 pid: 14228 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.281944:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378361.281950:0:14213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.281958:0:14213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.281964:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787378361.282027:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad37a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+23:2353:x1874201604644224:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 164us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378361.282036:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00010000:00010000:3.0:1787378361.282514:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d78541c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72fe expref: 22 pid: 14228 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378361.282533:0:14229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14229:1874201626650496:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787378361.282545:0:14229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14229:1874201626650624:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787378361.282567:0:14229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378361.285996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378361.286111:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604644352 00000100:00100000:0.0:1787378361.286122:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604644352 00010000:00010000:0.0:1787378361.286181:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 22 pid: 14229 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378361.286226:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787378361.286235:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+22:2354:x1874201604644352:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787378361.286253:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378361.286259:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 22 pid: 14229 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.286271:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 22 pid: 14229 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.286294:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d78541b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a72f7 expref: 22 pid: 14229 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.286311:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:0.0:1787378361.286316:0:14214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.286326:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.286332:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.286380:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378361.286450:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+21:2354:x1874201604644352:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 215us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378361.286458:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00010000:00010000:3.0:1787378361.286651:0:14229:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.286670:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378361.286689:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787378361.286895:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785420d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a731a expref: 22 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.286910:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13800/0xdd3c5462d7854214 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a731a expref: 21 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.286916:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:3.0:1787378361.286919:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787378361.286922:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e13800, rc 0) 00000100:00100000:3.0:1787378361.286949:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+21:14471:x1874201604644096:12345-192.168.203.22@tcp:101:dd.0 Request processed in 8681us (8927us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787378361.286957:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:1.0:1787378361.290179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378361.290279:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604644608 00000100:00100000:2.0:1787378361.290288:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604644608 00000100:00100000:2.0:1787378361.290349:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:2.0:1787378361.290359:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+21:14471:x1874201604644608:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:2.0:1787378361.290643:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.290659:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.290670:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378361.290758:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787378361.290816:0:14228:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e3e10759 reply state 000000004f92f9f6 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378361.290827:0:14228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378361.290942:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+24:14471:x1874201604644608:12345-192.168.203.22@tcp:36:dd.0 Request processed in 583us (770us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787378361.290949:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000020:00080000:2.0:1787378361.290955:0:14228:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787378361.294903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378361.295002:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604644736 00000100:00100000:0.0:1787378361.295012:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604644736 00000100:00100000:0.0:1787378361.295077:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:0.0:1787378361.295089:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+24:14471:x1874201604644736:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1787378361.295113:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378361.295135:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7854229 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7321 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.295204:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7854229 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7321 expref: 25 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.295221:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7854229 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7321 expref: 25 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.295241:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:0.0:1787378361.295245:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787378361.295249:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128aa00, rc 0) 00000100:00100000:0.0:1787378361.295303:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+25:14471:x1874201604644736:12345-192.168.203.22@tcp:101:dd.0 Request processed in 216us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378361.295311:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00010000:00010000:3.0:1787378361.295429:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.295439:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.295447:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.295453:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1400 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378361.295458:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.295483:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.295495:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:3.0:1787378361.295498:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378361.295501:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378361.295507:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854222 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378361.310711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378361.310888:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604644992 00000100:00100000:0.0:1787378361.310903:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604644992 00000100:00100000:0.0:1787378361.310996:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1787378361.311008:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+24:14471:x1874201604644992:12345-192.168.203.22@tcp:103:dd.0 00010000:00010000:0.0:1787378361.311025:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378361.311050:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7854229 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7321 expref: 24 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378361.311069:0:14215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:0.0:1787378361.311074:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378361.311134:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+23:14471:x1874201604644992:12345-192.168.203.22@tcp:103:dd.0 Request processed in 129us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378361.311151:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:1.0:1787378361.313877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378361.314272:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604645120 00000100:00100000:2.0:1787378361.314284:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604645120 00000100:00100000:2.0:1787378361.314391:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:2.0:1787378361.314402:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+23:14471:x1874201604645120:12345-192.168.203.22@tcp:58:dd.0 00010000:00010000:2.0:1787378361.314498:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.314514:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.314525:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787378361.315453:0:14228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787378361.315621:0:14228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787378361.315694:0:14228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787378361.315838:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+23:14471:x1874201604645120:12345-192.168.203.22@tcp:58:dd.0 Request processed in 1435us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378361.315849:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:1.0:1787378361.318128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378361.318284:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604645248 00000100:00100000:2.0:1787378361.318294:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604645248 00000100:00100000:2.0:1787378361.318357:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:2.0:1787378361.318367:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+23:14471:x1874201604645248:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:2.0:1787378361.318410:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378361.318432:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854237 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7328 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.318482:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.318492:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854237 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7328 expref: 24 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.318511:0:14228:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.318525:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854237 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7328 expref: 24 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.318538:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378361.318541:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787378361.318545:0:14228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854237 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7328 expref: 24 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378361.318553:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1400, rc 0) 00000100:00100000:2.0:1787378361.318595:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+24:14471:x1874201604645248:12345-192.168.203.22@tcp:101:dd.0 Request processed in 230us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378361.318602:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00010000:00010000:2.0:1787378361.370060:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787378361.939905:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934602 is committed 00000001:00080000:0.0:1787378361.939924:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787378361.939940:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:0.0:1787378361.939964:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:1.0:1787378362.074453:0:14263:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787378362.074462:0:14263:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787378362.074501:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787378362.074506:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787378362.074629:0:14263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebaf44ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14263:1874201626650752:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787378362.074761:0:14263:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb867290c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378362.083442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.083762:0:14263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebaf44ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14263:1874201626650752:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787378362.084178:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604645376 00000100:00100000:2.0:1787378362.084185:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604645376 00000100:00100000:2.0:1787378362.084251:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787378362.084259:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14473:x1874201604645376:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787378362.084339:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14473:x1874201604645376:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 Request processed in 80us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.084347:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:3.0:1787378362.088011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.088241:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604645504 00000100:00100000:2.0:1787378362.088252:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604645504 00000100:00100000:2.0:1787378362.088319:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:2.0:1787378362.088330:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14473:x1874201604645504:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787378362.088360:0:16163:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787378362.088481:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14473:x1874201604645504:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 153us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.088489:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1787378362.092089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.092251:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604645632 00000100:00100000:2.0:1787378362.092262:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604645632 00000100:00100000:2.0:1787378362.092325:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1787378362.092335:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14473:x1874201604645632:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787378362.092413:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092429:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092441:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092515:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092537:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092545:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092568:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092576:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092583:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378362.092622:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787378362.092626:0:14229:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787378362.092640:0:14229:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092650:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092656:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092662:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092667:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378362.092671:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092683:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092696:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb85524300) 00010000:00010000:2.0:1787378362.092699:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378362.092704:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092710:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785423e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092765:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092772:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092778:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092782:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378362.092785:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092790:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092797:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9eeb87ea5900) 00010000:00010000:2.0:1787378362.092800:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378362.092803:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092819:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854245 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092834:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092839:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092845:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092850:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378362.092853:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.092859:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.094039:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378362.094042:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787378362.094046:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.094053:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1800/0xdd3c5462d785424c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.094155:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14473:x1874201604645632:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 1817us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.094173:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1787378362.099936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.100422:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604645888 00000100:00100000:2.0:1787378362.100432:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604645888 00000100:00100000:2.0:1787378362.100485:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1787378362.100494:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:14473:x1874201604645888:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787378362.100515:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787378362.100536:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854253 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a732f expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100636:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100650:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100662:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787378362.100672:0:16163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787378362.100846:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100854:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100860:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100878:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:2.0:1787378362.100882:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100889:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100915:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:2.0:1787378362.100986:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787378362.100991:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.100998:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1c00/0xdd3c5462d785425a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.101043:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854253 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a732f expref: 13 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.101053:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eeb85524300) 00010000:00010000:2.0:1787378362.101055:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787378362.101059:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854253 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a732f expref: 13 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.101068:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb82bc1600, rc 0) 00000100:00100000:2.0:1787378362.101127:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+12:14473:x1874201604645888:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 633us (1213us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787378362.101146:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:1.0:1787378362.106628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.106709:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604646016 00000100:00100000:0.0:1787378362.106742:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604646016 00000100:00100000:0.0:1787378362.106792:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1787378362.106801:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+12:14473:x1874201604646016:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787378362.106831:0:14230:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787378362.106938:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+12:14473:x1874201604646016:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 137us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.106945:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1787378362.112824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.116175:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604646272 00000100:00100000:0.0:1787378362.116189:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604646272 00000100:00100000:0.0:1787378362.116317:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1787378362.116328:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+12:14473:x1874201604646272:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378362.116349:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378362.116369:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7854268 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7336 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787378362.119614:0:14228:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1787378362.119627:0:14228:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1787378362.119677:0:14228:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787378362.126542:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785426f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.126565:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785426f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.126577:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785426f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.126650:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d7854268 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7336 expref: 15 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.126671:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785426f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7336 expref: 14 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.126679:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378362.126683:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787378362.126686:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128be00, rc 0) 00000100:00100000:0.0:1787378362.126770:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14473:x1874201604646272:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 10443us (13956us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787378362.126796:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:1.0:1787378362.138822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.139143:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604646528 00000100:00100000:0.0:1787378362.139152:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604646528 00000100:00100000:0.0:1787378362.139210:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1787378362.139219:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14473:x1874201604646528:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787378362.139274:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787378362.139301:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128be00/0xdd3c5462d785426f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7336 expref: 14 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.139321:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb829cda00) 00010000:00010000:0.0:1787378362.139332:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787378362.139357:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.139370:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.139379:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.139444:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.139452:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.139458:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140069:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140080:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140086:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140093:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128b800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378362.140097:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140104:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140115:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eeb916d9800) 00010000:00010000:0.0:1787378362.140117:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378362.140121:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140128:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128b800/0xdd3c5462d785427d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140149:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140155:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140161:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140172:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:0.0:1787378362.140176:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140182:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140189:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xaa02011e (ffff9eeb829cd100) 00010000:00010000:0.0:1787378362.140191:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787378362.140193:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.140199:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d7854284 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaa02011e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378362.140285:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+13:14473:x1874201604646528:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1064us (1472us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787378362.140293:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1787378362.144637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.145386:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604646656 00000100:00100000:2.0:1787378362.145461:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604646656 00000100:00100000:3.0:1787378362.145673:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:3.0:1787378362.145684:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+13:14473:x1874201604646656:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787378362.145705:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378362.145770:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785428b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a733d expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.145826:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d7854292 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.145840:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d7854292 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.145852:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d7854292 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.146562:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d785428b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a733d expref: 15 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.146603:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e13a00/0xdd3c5462d7854292 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a733d expref: 14 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.146612:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:3.0:1787378362.146615:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787378362.146619:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e13a00, rc 0) 00000100:00100000:3.0:1787378362.146690:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14473:x1874201604646656:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1007us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378362.146698:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:1.0:1787378362.151619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.151709:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604646912 00000100:00100000:0.0:1787378362.151992:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604646912 00000100:00100000:2.0:1787378362.152208:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1787378362.152222:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14473:x1874201604646912:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787378362.152322:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.152338:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.152357:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787378362.153487:0:14229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787378362.153500:0:14229:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 498415779552ns, next at 499415777500ns, rc = 0 00000004:00010000:2.0:1787378362.153587:0:14229:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8a8c02c reply state 00000000e51423c4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.153598:0:14229:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787378362.153828:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:14473:x1874201604646912:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1608us (2217us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787378362.153837:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1787378362.157357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:3.0:1787378362.158272:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.158288:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.158296:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.158303:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378362.158307:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.158316:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.158333:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:3.0:1787378362.158336:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787378362.158341:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.158361:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1600/0xdd3c5462d7854299 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378362.158644:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604647040 00000100:00100000:0.0:1787378362.158655:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604647040 00000100:00100000:0.0:1787378362.159092:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1787378362.159105:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+15:14473:x1874201604647040:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378362.159127:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378362.159156:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7344 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.159229:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 16 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.159242:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 16 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.159261:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:0.0:1787378362.159264:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787378362.159267:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128a800, rc 0) 00000100:00100000:0.0:1787378362.159328:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:14473:x1874201604647040:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 226us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.159335:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:2.0:1787378362.163225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378362.163300:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604647168 00000100:00100000:3.0:1787378362.163311:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604647168 00000100:00100000:3.0:1787378362.163382:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1787378362.163402:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2354:x1874201604647168:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787378362.164156:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2354:x1874201604647168:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 763us (938us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787378362.164164:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00080000:0.0:1787378362.165524:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787378362.167366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.167526:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604647424 00000100:00100000:2.0:1787378362.167536:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604647424 00000100:00100000:2.0:1787378362.167600:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787378362.167609:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:14473:x1874201604647424:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787378362.168532:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+17:14473:x1874201604647424:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 919us (1171us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787378362.168543:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1787378362.171230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.171642:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604647680 00000100:00100000:0.0:1787378362.171652:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604647680 00000100:00100000:0.0:1787378362.171847:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1787378362.171858:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+17:14473:x1874201604647680:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787378362.171982:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+17:14473:x1874201604647680:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 127us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.171990:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:1.0:1787378362.177833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378362.178104:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604647808 00000100:00100000:3.0:1787378362.178114:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604647808 00000100:00100000:3.0:1787378362.178182:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787378362.178193:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+17:14473:x1874201604647808:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787378362.178213:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787378362.178232:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d78542a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a734b expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.178302:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d78542ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.178317:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d78542ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.178329:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d78542ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787378362.178377:0:16163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787378362.178410:0:16163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d78542ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.178437:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12400/0xdd3c5462d78542a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a734b expref: 19 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.178453:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d78542ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a734b expref: 18 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.178462:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:3.0:1787378362.178465:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787378362.178468:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eea82e12200, rc 0) 00000100:00100000:3.0:1787378362.178533:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+18:14473:x1874201604647808:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 342us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378362.178542:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:1.0:1787378362.183301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.184126:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604647936 00000100:00100000:0.0:1787378362.184151:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604647936 00000100:00100000:0.0:1787378362.184221:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1787378362.184233:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+6:2354:x1874201604647936:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787378362.184250:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787378362.184289:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7352 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378362.184319:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a893aba, blocks: 0x1 00010000:00010000:0.0:1787378362.184337:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787378362.184342:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378362.184353:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 7 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.184371:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 7 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.184384:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9128b800, rc 0) 00000100:00100000:0.0:1787378362.184524:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:2354:x1874201604647936:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 291us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.184532:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1787378362.191332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.191584:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604648192 00000100:00100000:2.0:1787378362.191594:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604648192 00000100:00100000:2.0:1787378362.191657:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1787378362.191667:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+18:14473:x1874201604648192:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787378362.192094:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+18:14473:x1874201604648192:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 426us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.192120:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:1.0:1787378362.205591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378362.205675:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604648320 00000100:00100000:3.0:1787378362.205685:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604648320 00000100:00100000:3.0:1787378362.205795:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787378362.205805:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+18:14473:x1874201604648320:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787378362.279257:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1787378362.279278:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787378362.279285:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787378362.279514:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb881f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626650880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787378362.279633:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14473:x1874201604648320:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 73827us (74051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.279645:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:1.0:1787378362.280442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378362.280528:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626650880 00000100:00100000:2.0:1787378362.280536:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626650880 00000100:00100000:2.0:1787378362.280592:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787378362.280600:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874201626650880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787378362.280781:0:14865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787378362.280785:0:14865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787378362.280787:0:14865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787378362.280789:0:14865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787378362 -> 1787378362 00002000:00010000:2.0:1787378362.280791:0:14865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787378362.280831:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1874201626650880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (392us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787378362.280837:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787378362.281125:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eeb881f0380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787378362.281141:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb881f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874201626650880:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787378362.283142:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378362.285534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378362.289311:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604648448 00000100:00100000:3.0:1787378362.289326:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604648448 00000100:00100000:3.0:1787378362.289403:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1787378362.289413:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:2353:x1874201604648448:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787378362.289530:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:2353:x1874201604648448:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 118us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378362.289557:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787378362.293372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378362.293437:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604648704 00000100:00100000:1.0:1787378362.293455:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604648704 00000100:00100000:1.0:1787378362.293515:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:1.0:1787378362.293525:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14473:x1874201604648704:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787378362.293580:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787378362.293608:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eea82e12200/0xdd3c5462d78542ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a734b expref: 14 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.293628:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:1.0:1787378362.293632:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787378362.293659:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.293672:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.293681:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787378362.294385:0:14229:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025cc8051 reply state 000000009fcdc59d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378362.294420:0:14229:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787378362.294536:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+15:14473:x1874201604648704:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1010us (1171us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787378362.294545:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00010000:00010000:3.0:1787378362.301628:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.301646:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.301654:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.301659:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd05e00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:3.0:1787378362.301664:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.301670:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.301686:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:3.0:1787378362.301689:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787378362.301694:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.301699:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd05e00/0xdd3c5462d78542bc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.305559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378362.305671:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604648832 00000100:00100000:1.0:1787378362.305685:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604648832 00000100:00100000:1.0:1787378362.305784:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787378362.305795:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:14473:x1874201604648832:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787378362.305814:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787378362.305835:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa3770d0ff93a7359 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.305869:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 8 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.305878:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378362.305882:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378362.305887:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 8 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.305990:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 8 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.306006:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 8 pid: 14864 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378362.306040:0:14864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14864:1874201626651008:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787378362.306149:0:14864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eebb8ce4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787378362.308582:0:14864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14864:1874201626651008:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378362.308616:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 8 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.308653:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eeb9dd05400, rc 0) 00000100:00100000:0.0:1787378362.308712:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+8:14473:x1874201604648832:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2918us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.308745:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1787378362.310959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.311125:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604648960 00000100:00100000:2.0:1787378362.311143:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604648960 00010000:00010000:2.0:1787378362.311190:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 8 pid: 14864 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.311227:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:2.0:1787378362.311236:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+8:2354:x1874201604648960:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378362.311248:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378362.311269:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 8 pid: 14864 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.311298:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 8 pid: 14864 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.311321:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000438e5797/0xdd3c5462d78542b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7352 expref: 8 pid: 14864 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.311337:0:14213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378362.311342:0:14213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378362.311348:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 7 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.311357:0:14213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 7 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.311400:0:14213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 7 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.311414:0:14213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eeb867db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14213:1874201626651136:192.168.203.22@tcp:105: 00000100:00100000:2.0:1787378362.311482:0:14213:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787378362.314272:0:14213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eeb867db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14213:1874201626651136:192.168.203.22@tcp:105: 00010000:00010000:0.0:1787378362.314298:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787378362.314356:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:2354:x1874201604648960:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 3119us (3402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.314366:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1787378362.316978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378362.317105:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604649088 00000100:00100000:3.0:1787378362.317114:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604649088 00000100:00100000:3.0:1787378362.317183:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1787378362.317193:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:2353:x1874201604649088:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787378362.317416:0:14866:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787378362.317420:0:14866:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787378361 00002000:00010000:3.0:1787378362.317423:0:14866:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787378360 00002000:00010000:3.0:1787378362.317425:0:14866:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787378362 -> 1787378361 00002000:00010000:3.0:1787378362.317427:0:14866:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787378362.317535:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+8:2353:x1874201604649088:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 343us (565us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787378362.317544:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1787378362.320798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.320956:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604649216 00000100:00100000:0.0:1787378362.320966:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604649216 00000100:00100000:0.0:1787378362.321023:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1787378362.321033:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb881f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+8:2354:x1874201604649216:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787378362.321075:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.321095:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 8 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.321103:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378362.321108:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787378362.321112:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.321192:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 8 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.321207:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 8 pid: 14864 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378362.321223:0:14864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14864:1874201626651264:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378362.321609:0:14864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787378362.325279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.325424:0:14864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14864:1874201626651264:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787378362.325451:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.325892:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604649344 00000100:00100000:2.0:1787378362.325900:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604649344 00010000:00010000:2.0:1787378362.326003:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 9 pid: 14864 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.326095:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:2.0:1787378362.326105:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+9:2353:x1874201604649344:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787378362.326121:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787378362.326152:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 9 pid: 14864 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.326173:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 9 pid: 14864 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.326195:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091023fe6/0xdd3c5462d78542c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7359 expref: 9 pid: 14864 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.326212:0:14214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787378362.326217:0:14214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787378362.326222:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.326231:0:14214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.326263:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787378362.326384:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.326401:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.326424:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.326433:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.326441:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.326448:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378362.326452:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.326460:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.326482:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.326490:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d78542ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.326559:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+8:2353:x1874201604649344:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 454us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.326567:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1787378362.327177:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb881f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:2354:x1874201604649216:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 6141us (6384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378362.327188:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1787378362.329680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787378362.329781:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604649600 00000100:00100000:0.0:1787378362.329790:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604649600 00000100:00100000:0.0:1787378362.329843:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1787378362.329852:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb867db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:14473:x1874201604649600:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787378362.329945:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.329963:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.329976:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.330250:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.330263:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 15 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.330271:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.330306:0:14228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 15 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.330320:0:14228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 15 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378362.330336:0:14228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae98aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1874201626651392:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787378362.334062:0:14228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb845663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787378362.335482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378362.335571:0:14228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae98aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1874201626651392:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787378362.335596:0:14228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378362.335659:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604649728 00000100:00100000:3.0:1787378362.335666:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604649728 00010000:00010000:3.0:1787378362.335699:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 16 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378362.335756:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1787378362.335775:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:2353:x1874201604649728:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787378362.335790:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787378362.335797:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 16 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.335810:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 16 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.335833:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a800/0xdd3c5462d78542a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7344 expref: 16 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.335847:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:3.0:1787378362.335864:0:14213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.335874:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.335881:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.335912:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787378362.335968:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+15:2353:x1874201604649728:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 194us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378362.335977:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00010000:00010000:2.0:1787378362.336331:0:14228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.336340:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378362.336521:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787378362.336664:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787378362.336710:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787378362.337004:0:14228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14228:1874201626651520:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787378362.337100:0:14228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378362.337145:0:14228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb8762f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787378362.338398:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626651520 00000100:00100000:3.0:1787378362.338409:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626651520 00000100:00100000:3.0:1787378362.338508:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787378362.338517:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14228:x1874201626651520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787378362.338622:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14228:x1874201626651520:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378362.338630:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787378362.338812:0:14228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14228:1874201626651520:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787378362.339486:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787378362.339572:0:14228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14228:1874201626651648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787378362.339622:0:14228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378362.340251:0:14228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378362.340303:0:14234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626651648 00000100:00100000:2.0:1787378362.340311:0:14234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626651648 00000100:00100000:2.0:1787378362.340349:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787378362.340357:0:14234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebb50dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14228:x1874201626651648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787378362.340669:0:14234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebb50dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14228:x1874201626651648:12345-0@lo:1000:mdt00_000.0 Request processed in 311us (1045us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787378362.340678:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787378362.341026:0:14228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14228:1874201626651648:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787378362.341064:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341074:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341098:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341104:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378362.341108:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341116:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341145:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:1.0:1787378362.341148:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378362.341153:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341160:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128a600/0xdd3c5462d78542d8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341192:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341198:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341203:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341208:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1000 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378362.341211:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341226:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341236:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:1.0:1787378362.341238:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787378362.341244:0:14228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854237 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7328 expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341254:0:14228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854237 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7328 expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341262:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854237 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7328 expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.341291:0:14228:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1400/0xdd3c5462d7854237 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xa3770d0ff93a7328 expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378362.341303:0:14228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1874201626651776:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787378362.341475:0:14228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9eeb917bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787378362.344914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378362.345119:0:14228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1874201626651776:192.168.203.22@tcp:105: 00010000:00010000:1.0:1787378362.345181:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345192:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb82bc1000/0xdd3c5462d7854230 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345224:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345251:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345262:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345273:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345279:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345285:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345291:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378362.345295:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345301:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345311:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:1.0:1787378362.345314:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787378362.345317:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345323:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04600/0xdd3c5462d78542df lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345333:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345346:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345353:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345357:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128aa00 already unused, calling callback (ffffffffc21df4f0) 00010000:00010000:1.0:1787378362.345360:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345366:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.345375:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eeb87ea5800) 00010000:00010000:1.0:1787378362.345377:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787378362.345380:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378362.345613:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604649856 00000100:00100000:3.0:1787378362.345621:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604649856 00010000:00010000:1.0:1787378362.345621:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9128aa00/0xdd3c5462d78542d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378362.345674:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1787378362.345683:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eeb8442f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+19:14471:x1874201604649856:12345-192.168.203.22@tcp:49:dd.0 00000100:00100000:1.0:1787378362.346141:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb867db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+19:14473:x1874201604649600:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 16279us (16458us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787378362.346150:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000020:00080000:1.0:1787378362.346154:0:14228:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787378362.346255:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eeb8442f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00d50ef6-d535-4a72-b1e6-41488fdde5e5+18:14471:x1874201604649856:12345-192.168.203.22@tcp:49:dd.0 Request processed in 572us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.346262:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000040:00080000:0.0:1787378362.346331:0:14263:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787378362.346336:0:14263:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787378362.346364:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787378362.346369:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787378362.349031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378362.349212:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604650112 00000100:00100000:1.0:1787378362.349222:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604650112 00000100:00100000:1.0:1787378362.349275:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:1.0:1787378362.349283:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+18:14473:x1874201604650112:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787378362.350190:0:14231:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787378362.350297:0:14231:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1787378362.350342:0:14231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.350358:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.350370:0:14231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.350378:0:14231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.350473:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.350480:0:14231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.350502:0:14231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787378362.350630:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+20:14473:x1874201604650112:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1344us (1605us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787378362.350639:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000020:00080000:1.0:1787378362.350643:0:14231:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787378362.350707:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787378362.350713:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.350743:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378362.350757:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.350773:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.350787:0:14216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eeb916d9d00) 00010000:00010000:3.0:1787378362.350790:0:14216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787378362.350794:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.350800:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eeb9dd04000/0xdd3c5462d78542e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.350812:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378362.350814:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787378362.350815:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787378362.395142:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3312:1874201626652032:0@lo:400:kworker.0 00000100:00100000:1.0:1787378362.395214:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378362.395254:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874201626652544:0@lo:400:kworker.0 00000100:00100000:1.0:1787378362.395282:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378362.395324:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787378362.395330:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebae6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626651904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378362.395361:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378362.395377:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626652416:0@lo:400:kworker.0 00000100:00100000:2.0:1787378362.395515:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebb50dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626652160:0@lo:400:kworker.0 00000100:00100000:2.0:1787378362.395544:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787378362.395586:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787378362.395592:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626652288:0@lo:400:kworker.0 00000100:00100000:2.0:1787378362.395614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378362.396225:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626651904 00000100:00100000:0.0:1787378362.396235:0:14868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626651904 00000100:00100000:0.0:1787378362.396295:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787378362.396304:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626651904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787378362.396339:0:14868:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787378362.396499:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626652160 00000100:00100000:3.0:1787378362.396504:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626652160 00000100:00100000:3.0:1787378362.396537:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787378362.396544:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626652160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787378362.396587:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874201626652160:12345-0@lo:400:kworker.0 Request processed in 43us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787378362.396595:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787378362.396638:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626652160:0@lo:400:kworker.0 00000100:00100000:0.0:1787378362.396912:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874201626651904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.397062:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787378362.398069:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787378362.398150:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebae6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874201626651904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787378362.398200:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626652032 00000100:00100000:1.0:1787378362.398206:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626652032 00000100:00100000:1.0:1787378362.398255:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787378362.398264:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3312:x1874201626652032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787378362.398315:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606b5901-a2d8-4f42-a60c-6eb8ab84a876+19:3312:x1874201626652032:12345-0@lo:400:kworker.0 Request processed in 52us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378362.398321:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787378362.398498:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626652544 00000100:00100000:2.0:1787378362.398503:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626652544 00000100:00100000:2.0:1787378362.398534:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626652288 00000100:00100000:2.0:1787378362.398537:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626652288 00000100:00100000:2.0:1787378362.398548:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626652416 00000100:00100000:2.0:1787378362.398550:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626652416 00000100:00100000:2.0:1787378362.398563:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787378362.398568:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874201626652544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378362.398605:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874201626652544:12345-0@lo:400:kworker.0 Request processed in 37us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.398611:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787378362.398623:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787378362.398629:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626652288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378362.398658:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874201626652288:12345-0@lo:400:kworker.0 Request processed in 30us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.398664:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787378362.398674:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787378362.398680:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626652416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787378362.398704:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874201626652416:12345-0@lo:400:kworker.0 Request processed in 25us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378362.398710:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787378362.398829:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874201626652288:0@lo:400:kworker.0 00000100:00080000:0.0:1787378362.399335:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787378362.399342:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787378362.400270:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787378362.400354:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874201626652416:0@lo:400:kworker.0 00000100:00100000:0.0:1787378362.400368:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebb50dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606b5901-a2d8-4f42-a60c-6eb8ab84a876:3312:1874201626652032:0@lo:400:kworker.0 00000100:00100000:0.0:1787378362.400378:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874201626652544:0@lo:400:kworker.0 00000100:00100000:2.0:1787378362.622852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.622908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378362.623033:0:14869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604650368 00000100:00100000:1.0:1787378362.623043:0:14869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604650368 00000100:00100000:1.0:1787378362.623107:0:14869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604650240 00000100:00100000:1.0:1787378362.623111:0:14869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604650240 00000100:00100000:1.0:1787378362.623142:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787378362.623151:0:14869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+8:2355:x1874201604650368:12345-192.168.203.22@tcp:4:dd.0 00002000:00010000:1.0:1787378362.623200:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a893ab9, atime: 0x6a893ab8, ctime: 0x6a893ab9, blocks: 0x1 00010000:00010000:1.0:1787378362.623221:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.623237:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1787378362.623242:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378362.623249:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.623271:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.629683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787378362.629883:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787378362.629894:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787378362.631182:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604650496 00000100:00100000:3.0:1787378362.631194:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604650496 00000100:00100000:0.0:1787378362.631702:0:16358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787378362.631714:0:16358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebae6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+10:2355:x1874201604650240:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:0.0:1787378362.632179:0:16358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.632199:0:16358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378362.632204:0:16358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378362.632210:0:16358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.632224:0:16358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.645475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.645518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.645547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.645560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787378362.645575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378362.645697:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787378362.645708:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787378362.646352:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787378362.646365:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604650624 00000100:00100000:3.0:1787378362.646385:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604650624 00000100:00100000:3.0:1787378362.646436:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787378362.646442:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604650752 00000100:00100000:3.0:1787378362.646444:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604650752 00000100:00100000:3.0:1787378362.646456:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787378362.646461:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604650880 00000100:00100000:3.0:1787378362.646463:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604650880 00000100:00100000:3.0:1787378362.646472:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787378362.646477:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604651008 00000100:00100000:3.0:1787378362.646479:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604651008 00000100:00100000:3.0:1787378362.646488:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787378362.646493:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604651136 00000100:00100000:3.0:1787378362.646495:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604651136 00000100:00100000:1.0:1787378362.647801:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:1.0:1787378362.647816:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:2356:x1874201604650496:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:1.0:1787378362.647913:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.647931:0:16359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378362.647935:0:16359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378362.647940:0:16359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.647954:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787378362.846749:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1787378362.846780:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1787378362.846997:0:16358:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1787378362.847002:0:16358:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787378361 -> 1787378362 00002000:00010000:2.0:1787378362.847005:0:16358:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787378361 -> 1787378362 00002000:00010000:2.0:1787378362.847007:0:16358:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1787378362.847023:0:16358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.847036:0:16358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.847045:0:16358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.847053:0:16358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128a800 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378362.847059:0:16358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.847069:0:16358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.847093:0:16358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.847119:0:16358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000213d9fda/0xdd3c5462d78542f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.847220:0:16358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:2355:x1874201604650240:12345-192.168.203.22@tcp:4:dd.0 Request processed in 215502us (224305us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787378362.847234:0:16358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:2.0:1787378362.847273:0:16358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1787378362.847286:0:16358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+15:2355:x1874201604650624:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:2.0:1787378362.847320:0:16358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.847333:0:16358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787378362.847337:0:16358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378362.847344:0:16358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.847355:0:16358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787378362.863362:0:14869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1787378362.863388:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.863402:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.863427:0:14869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.863433:0:14869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378362.863438:0:14869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.863447:0:14869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.863466:0:14869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.863473:0:14869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f2b0a3b/0xdd3c5462d78542ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378362.863565:0:14869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebae6f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+15:2355:x1874201604650368:12345-192.168.203.22@tcp:4:dd.0 Request processed in 240411us (240731us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787378362.863576:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1787378362.863610:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1787378362.863621:0:14869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+14:2356:x1874201604650752:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:0.0:1787378362.863650:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.863660:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378362.863670:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787378362.863677:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378362.863688:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378362.907151:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626652672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787378362.907226:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787378362.908376:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201626652672 00000100:00100000:0.0:1787378362.908395:0:14868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201626652672 00000100:00100000:0.0:1787378362.908445:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787378362.908454:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626652672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787378362.908481:0:14868:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 66387968 pending 5111808 free 3859808256 avail 3855613952 00000100:00100000:0.0:1787378362.908544:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874201626652672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787378362.908551:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787378362.908597:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787378362.908603:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eeb881f0380, transno 8589934595 00000004:00080000:0.0:1787378362.908615:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787378362.908640:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9eebade81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874201626652672:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787378362.933738:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1787378362.934225:0:16359:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00010000:00010000:2.0:1787378362.934242:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.934257:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.934282:0:16359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.934289:0:16359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:2.0:1787378362.934294:0:16359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.934303:0:16359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.934323:0:16359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.934331:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d78542fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787378362.934430:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:00d50ef6-d535-4a72-b1e6-41488fdde5e5+16:2356:x1874201604650496:12345-192.168.203.22@tcp:4:dd.0 Request processed in 286613us (304750us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787378362.934441:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1787378362.934470:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1787378362.934481:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:00d50ef6-d535-4a72-b1e6-41488fdde5e5+15:2355:x1874201604650880:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:2.0:1787378362.934511:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.934522:0:16359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378362.934532:0:16359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378362.934538:0:16359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.934550:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787378362.980228:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:3.0:1787378362.986716:0:16358:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1787378362.986746:0:16358:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:3.0:1787378362.986761:0:16358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.986774:0:16358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.986783:0:16358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.986790:0:16358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1c00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:3.0:1787378362.986795:0:16358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.986819:0:16358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.986840:0:16358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787378362.986847:0:16358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036fbce23/0xdd3c5462d7854302 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.988048:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.988062:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.988080:0:14869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.988087:0:14869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9128be00 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378362.988091:0:14869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.988100:0:14869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.988114:0:14869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.988121:0:14869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ad3563/0xdd3c5462d7854309 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378362.988971:0:14869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+12:2356:x1874201604650752:12345-192.168.203.22@tcp:4:dd.0 Request processed in 125344us (343443us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787378362.988984:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1787378362.989017:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787378362.989029:0:14869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:2356:x1874201604651008:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:1.0:1787378362.989061:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.989074:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378362.989086:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787378362.989092:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378362.989105:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787378362.995305:0:16358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebaf44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+11:2355:x1874201604650624:12345-192.168.203.22@tcp:4:dd.0 Request processed in 148013us (349829us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787378362.995322:0:16358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1787378362.997112:0:16358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1787378362.997141:0:16358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebad2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+10:2355:x1874201604651136:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:2.0:1787378362.997182:0:16358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.997198:0:16358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378362.997202:0:16358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787378362.997210:0:16358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787378362.997222:0:16358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787378363.040659:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1787378363.040775:0:16359:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:0.0:1787378363.040791:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.040806:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.040816:0:16359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.040837:0:16359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1600 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378363.040843:0:16359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.040852:0:16359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.040874:0:16359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.040883:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000711e82fa/0xdd3c5462d7854310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378363.040975:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:00d50ef6-d535-4a72-b1e6-41488fdde5e5+13:2355:x1874201604650880:12345-192.168.203.22@tcp:4:dd.0 Request processed in 106492us (395422us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787378363.040985:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000001:00080000:2.0:1787378363.106922:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1787378363.107230:0:16358:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1787378363.107245:0:16358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.107258:0:16358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.107268:0:16358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.107289:0:16358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb82bc1000 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:0.0:1787378363.107294:0:16358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.107304:0:16358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.107323:0:16358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787378363.107330:0:16358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fadeaef/0xdd3c5462d785431e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787378363.107569:0:16358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:00d50ef6-d535-4a72-b1e6-41488fdde5e5+7:2355:x1874201604651136:12345-192.168.203.22@tcp:4:dd.0 Request processed in 110440us (461987us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787378363.107579:0:16358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00010000:00010000:1.0:1787378363.108029:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378363.108039:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378363.108046:0:14869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378363.108052:0:14869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eeb9dd04200 already unused, calling callback (ffffffffc17a3e90) 00010000:00010000:1.0:1787378363.108055:0:14869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378363.108061:0:14869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378363.108074:0:14869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787378363.108081:0:14869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f259f73/0xdd3c5462d7854317 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787378363.108169:0:14869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebad2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2356:x1874201604651008:12345-192.168.203.22@tcp:4:dd.0 Request processed in 119144us (462607us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787378363.108177:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00010000:00010000:3.0:1787378363.425564:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787378364.441884:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787378364.477310:0:16398:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1787378364.553272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378364.553325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378364.553349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378364.553366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378364.553385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378364.553400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378364.553482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787378364.553508:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604651520 00000100:00100000:1.0:1787378364.553517:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604651520 00000100:00100000:1.0:1787378364.553563:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604651648 00000100:00100000:1.0:1787378364.553566:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604651648 00000100:00100000:1.0:1787378364.553580:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604651904 00000100:00100000:1.0:1787378364.553583:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604651904 00000100:00100000:1.0:1787378364.553596:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604652032 00000100:00100000:1.0:1787378364.553598:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604652032 00000100:00100000:1.0:1787378364.553614:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1787378364.553623:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2356:x1874201604651520:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378364.553690:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2356:x1874201604651520:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 67us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378364.553697:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1787378364.553752:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787378364.553759:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2356:x1874201604651648:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378364.553792:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00d50ef6-d535-4a72-b1e6-41488fdde5e5+5:2356:x1874201604651648:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 34us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378364.553799:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787378364.553811:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787378364.553816:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2355:x1874201604651904:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378364.553836:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2355:x1874201604651904:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378364.553843:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787378364.553854:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1787378364.553859:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2355:x1874201604652032:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378364.553878:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e041587a-af59-45ee-bb79-c6ec38cf8b37+5:2355:x1874201604652032:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 19us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378364.553884:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1787378364.553907:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604651392 00000100:00100000:1.0:1787378364.553911:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604651392 00000100:00100000:1.0:1787378364.553936:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604651776 00000100:00100000:1.0:1787378364.553938:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604651776 00000100:00100000:1.0:1787378364.553953:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1787378364.553958:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+20:2356:x1874201604651392:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378364.553986:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00d50ef6-d535-4a72-b1e6-41488fdde5e5+20:2356:x1874201604651392:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378364.553992:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1787378364.554003:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787378364.554009:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebade83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2355:x1874201604651776:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787378364.554040:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebade83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e041587a-af59-45ee-bb79-c6ec38cf8b37+6:2355:x1874201604651776:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787378364.554047:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00080000:1.0:1787378364.554063:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787378364.554067:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787378364.554069:0:14224:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787378364.554168:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874201604651264 00000100:00100000:2.0:1787378364.554173:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874201604651264 00000100:00100000:2.0:1787378364.554209:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:2.0:1787378364.554216:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eebbf665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:2356:x1874201604651264:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787378364.554242:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eebbf665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a947f4-9814-4d6d-b4bb-f4a52d36ad66+13:2356:x1874201604651264:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787378364.554254:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00010000:00010000:3.0:1787378365.466137:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29645 lines, 29645 kept, 0 dropped, 0 bad.